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ESSA IMPLEMENTATION: EXPLORING 
STATE AND LOCAL REFORM EFFORTS 


Tuesday, July 18, 2017 
House of Representatives 
Committee on Education and the Workforce 
Washington, D.C. 


The Committee met, pursuant to call, at 10:02 a.m., in Room 
2175, Rayburn House Office Building, Hon. Virginia Foxx [chair- 
woman of the committee] presiding. 

Present: Representatives Foxx, Wilson of South Carolina, 
Walberg, Guthrie, Rokita, Barletta, Messer, Brat, Grothman, 
Stefanik, Allen, Lewis, Mitchell, Garrett, Smucker, Estes, Handel, 
Scott, Davis, Grijalva, Courtney, Fudge, Polis, Sablan, Bonamici, 
Takano, Adams, DeSaulnier, Norcross, Blunt Rochester, 
Krishnamoorthi, Shea-Porter, and Espaillat. 

Staff Present: Michael Comer, Press Secretary; Amy Raaf Jones, 
Director of Education and Human Resources Policy; Jonas Linde, 
Professional Staff Member; Nancy Locke, Chief Clerk; Kelley 
McNabb, Communications Director; Jake Middlebrooks, Legislative 
Assistant; James Mullen, Director of Information Technology; 
Krisann Pearce, General Counsel; Mandy Schaumburg, Education 
Deputy Director and Senior Counsel; Brad Thomas, Senior Edu- 
cation Policy Advisor; Michael Woeste, Press Secretary; Tylease 
Alli, Minority Clerk/Intern and Fellow Coordinator; Austin 
Barbera, Minority Press Assistant; Jacque Chevalier, Minority 
Education Policy Director; Denise Forte, Minority Staff Director; 
Mishawn Freeman, Minority Staff Assistant; Doug Hodum, Minor- 
ity Education Policy Fellow; Kimberly Knackstedt, Minority Dis- 
ability Policy Advisor; Veronique Pluviose, Minority General Coun- 
sel; andAneesh Sahni, Minority Education Policy Fellow. 

Chairwoman Foxx. The Committee on Education and the Work- 
force will come to order. Good morning and welcome to today’s full 
committee hearing. I thank our panel of witnesses and our com- 
mittee members for joining today’s discussion on the implementa- 
tion of the Every Student Succeeds Act, ESSA. 

ESSA can be considered a milestone for K-12 policy because it 
was a monumental shift in the role of States and school districts 
would have in the future of education. ESSA sought to achieve two 
specific goals for K-12 education: autonomy and accountability. 
States and school districts were given new independence when cre- 
ating a K-12 education program that works best for their own stu- 
dents, ending a Washington knows best approach to education. 
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Additionally, ESSA specifically prohibited the federal govern- 
ment from influencing States’ adoption of particular standards. It 
also repealed Federal mandates for teacher performance and pro- 
tected a State’s right to opt out of Federal education programs. 
Part of ESSA’s goal for State and school district autonomy was to 
force Washington to remain at arm’s length from States and school 
districts when it comes to education. And rest assured that this 
committee will be watching to ensure that Washington keeps its 
distance. 

While States and school districts were given more autonomy in 
ESSA, the law maintains provisions ensuring parents have trans- 
parent information about school performance and States and dis- 
tricts can hold schools accountable for delivering a high-quality 
education to all students. ESSA also included unprecedented re- 
strictions on the Department of Education’s authority to take back 
the State and local flexibility guaranteed by the law. 

ESSA has stripped away powers of the Department of Education, 
such as the ability of the Secretary of Education to legislate 
through executive fiat or the ability of the Department’s bureau- 
crats to substitute their judgment for States’. History made it clear 
that a top-down approach to K-12 education did not serve stu- 
dents, parents, teachers, or the States well, and ESSA directly ad- 
dressed the shortcomings. 

Given the monumental shift in education policy represented by 
ESSA, it is important that we hear how implementation is pro- 
gressing. We know the law will not fully take effect into the coming 
school year and we will need time to assess its impact on schools 
and students. However, I look forward to hearing from today’s wit- 
nesses about the progress State school districts and the Depart- 
ment of Education are making. 

This committee has been keeping a close eye on this implementa- 
tion process. Last year we held four hearings on implementation of 
ESSA. Today we will continue our discussion on ESSA’s implemen- 
tation. 

ESSA was truly a change for K-12 education and I do believe 
this bipartisan law delivers the proper balance of autonomy and ac- 
countability to parents and taxpayers while ensuring a limited Fed- 
eral role. This law has the ability to empower State and local lead- 
ers to change K-12 education for the better and that is why it is 
of utmost importance to this committee. I look forward to hearing 
from our witnesses and members during today’s hearing. 

With that, I yield to Ranking Member Scott for his opening re- 
marks. 

[The statement of Chairwoman Foxx follows:] 


Prepared Statement of Hon. Virginia Foxx, Chairwoman, Committee on 
Education and the Workforce 


Good morning, and welcome to today’s full committee hearing. I’d like to thank 
our panel of witnesses and our committee members for joining today’s discussion on 
the implementation of the Every Student Succeeds Act (ESSA). 

ESSA can be considered a milestone for K-12 policy because it was a monumental 
shift in the role states and school districts would have in the future of education. 

ESSA sought to achieve two specific goals for K-12 education: autonomy and ac- 
countability. 
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States and school districts were given new independence when creating a K-12 
education program that works best for their own students, ending a “Washington 
knows best” approach to education. 

Additionally, ESSA specifically prohibited the federal government from influ- 
encing states’ adoption of particular standards. It also repealed federal mandates for 
teacher performance and protected a state’s right to opt-out of federal education pro- 
grams. 

Part of ESSA’s goal for state and school district autonomy was to force Wash- 
ington to remain at arm’s length from states and school districts when it comes to 
education, and rest assured that this committee will be watching to ensure Wash- 
ington keeps its distance. 

While states and school districts were given more autonomy in ESSA, the law 
maintains provisions ensuring parents have transparent information about school 
performance and states and districts can hold schools accountable for delivering a 
high-quality education to all students. 

ESSA also included unprecedented restrictions on the Department of Education’s 
authority to take back the state and local flexibility guaranteed by the law. 

ESSA has stripped away powers of the Department of Education, such as the abil- 
ity of the Secretary of Education to legislate through executive fiat, or the ability 
of the Department’s bureaucrats to substitute their judgment for states’. 

History made it clear that a top down approach to K-12 education did not serve 
students, teachers, parents, or the states well, and ESSA directly addressed those 
shortcomings. 

Given the monumental shift in education policy represented by ESSA, it is impor- 
tant that we hear how implementation is progressing. . We know the law will not 
fully take effect until the coming school year, and we will need time to assess its 
impact on schools and students. However, I look forward to hearing from today’s 
witnesses about the progress states, school districts, and the Department of Edu- 
cation are making. 

This committee has been keeping a close eye on this implementation process. Last 
year, we held four hearings on implementation of ESSA. Today, we will continue 
our discussion on ESSA’s implementation. 

ESSA was truly a change for K-12 education, and I do believe this bipartisan law 
delivers the proper balance of autonomy and accountability to parents and tax- 
payers, while ensuring a limited federal role. 

This law has the ability to empower state and local leaders to change K-12 edu- 
cation for the better, and that is why it is of utmost importance to this committee. 

I look forward to hearing from our witnesses and members during today’s hearing. 


Mr. Scott. Thank you, Madam Chair, for convening this morn- 
ing’s hearing on implementation of the Every Student Succeeds 
Act. I would like to thank our witnesses for appearing today and 
I look forward to hearing their testimony. 

It is regrettable, however, Madam Chair, that we are not hearing 
from the U.S. Department of Education, particularly considering 
media reports of the majority’s intention to critique its implementa- 
tion of ESSA during today’s proceedings. I know I, for one, would 
greatly benefit from an open dialogue with the Department on 
ESSA implementation and for other matters. 

Chairwoman Foxx. you will remember that I sent you a letter 
urging Secretary DeVos and other agency heads to appear before 
the committee to discuss the administration’s priorities. That re- 
quest has not been fulfilled, so I would like to take the opportunity 
again to ask that Secretary DeVos or any other representative from 
the Department who can discuss the administration’s priorities ap- 
pear to engage in an open dialogue with this committee. 

Now, ESSA has been the law of the land for nearly 20 months. 
Now, while that may seem like a long time in the lifecycle of a law 
as consequential as the Elementary and Secondary Education Act 
which passed over 50 years ago, it is really just the beginning. 
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States are only now undergoing the peer review and plan ap- 
proval process followed by months of work amidst a regrettable 
chaotic regulatory environment. As I said, I said this in February 
and March, but it bears repeating, when Congress used the CRA 
to block the regulation of title ’s core requirements, that was un- 
fortunate and counter to the bipartisan agreement in ESSA. But 
this body did go forward with the CRA and now that is the reality 
that we have to work with. 

That lack of regulation, however, means increased subjectivity in 
determining compliance with the law’s requirements which makes 
oversight actions of this committee even more important. This in- 
creased subjectivity without the clarifying regulations is apparent 
in the Department’s early feedback on State plans that were sub- 
mitted in May, during the May submission window. Some plan 
components were praised by peer reviewers in one State’s plan 
while the same components were questioned as insufficient in an- 
other. All the while other violations of ESSA’s equity requirements 
were overlooked by the Department completely. 

Madam Chair, I am disappointed that the media description of 
the reaction from some of our colleagues in the majority who have 
characterized the Education Department’s feedback on State plans 
as overreach. There is a difference between overreach and simply 
administering the program. And we need to remember that ESSA 
was not a blank check to States and districts, and while the law 
afforded States and districts much flexibility, that flexibility must 
occur within the law, including guardrails concerning the assess- 
ments to ascertain persistent achievement gaps and accountability 
to close those achievement gaps. 

Congress designed the law’s guardrails to protect the interest of 
the underserved students. And the law contained important re- 
quirements, requirements Republicans and Democrats all agreed to 
when we voted for ESSA, and those requirements must be mean- 
ingful. Now, ESSA is not and never has been a free-for-all. It is the 
responsibility of the Department as articulated by Congress to 
carefully scrutinize the quality of State plans and only approve 
those that meet the law’s requirements. 

Even without regulations the law is the law. And the law re- 
quires the Secretary to review the plans, ask hard questions, and, 
if necessary, disapprove the plans in the interest of the students. 
And while, as I just mentioned, some of the content and overall in- 
consistency of the Department’s feedback may be problematic, I do 
not, and none of us should, take issue with the Department at- 
tempting to do its job. Feedback must be more, not less, consistent 
and more, not less, vigorous. And ultimately, the feedback and sub- 
mission of plans must result in approval only if the plans meet the 
spirit and the letter of the law. 

As we will hear today, many State plans leave much to be de- 
sired either due to ambiguity or incompleteness in response, or due 
to plan components that violate the law’s equity requirements. It 
is my hope that the Department will work with States, including 
through a provision of adequate guidance and technical assistance, 
to improve the overall quality of the State plans and ensure imple- 
mentation that honors the long civil rights focus of the ESEA. 
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Now, such implementation is only possible with the support and 
partnership of the Federal Government. It is not only the role of 
the Department to support and monitor State efforts to comply 
with the law, but it is also the role of Congress to fund programs 
authorized by ESSA. Despite promises to implement the law as 
Congress intended, Secretary DeVos and President Trump pro- 
posed the elimination of bedrock ESEA programs, like title H—A to 
support teachers, 21st Century Learning Centers to support after- 
school programs, and cuts to other programs, including an effective 
cut of nearly $600 million in title I. 

Now, while the House majority fiscal year 2018 Labor-H Appro- 
priations Bill is not as draconian as the President’s request, it fails 
to honor the bipartisan ESSA agreement by eliminating title I-A, 
cutting afterschool programs and maintaining an effective cut to 
title I that will be felt at the local level. Elimination of title II-A 
would result in thousands of layoffs and inhibit local and State ef- 
forts to improve teacher, paraprofessional, and school leader sup- 
ports. Defunding this program most certainly does not align with 
the bipartisan intent of the authorizing statute. 

And lastly, Trumpcare’s proposed cuts to Medicaid, if enacted, 
would devastate services for students with disabilities and under- 
mine State and local efforts to educate all students to high stand- 
ards as required by ESSA. And the situation would be even worse 
if the most recent repeal without a replace plan is enacted. 

Now, how effective can implementation be without funding? I 
know all too often that State and local education agencies face ca- 
pacity challenges and I would hope to hear from today’s witnesses 
about the negative impact of underfunding ESSA programs on 
faithful implementation. 

In closing, I remain concerned about many of the actions of Sec- 
retary DeVos and this administration concerning our Nation’s stu- 
dents for example, the recent rhetoric from the Office of Civil 
Rights and the office’s directive to ignore systemic data when they 
investigate alleged civil rights violations. The lack of agency capac- 
ity to carry out key components of the Department, including the 
absence of deputy secretaries, the rollback of protections for stu- 
dent borrowers, the rescinding of protections for transgender stu- 
dents, the sledgehammer-like approach to deregulation without 
transparency of decision-making of the Department, and the deci- 
sion to cancel the grant program to award $12 million to localities 
to provide technical assistance to help them desegregate their 
schools. All of these actions point to a troubling pattern that under- 
mines the Federal Government’s important role to protect and pro- 
mote civil rights of all students. 

This pattern must not continue with ESSA implementation. I say 
that not out of wishful thinking or partisan spin, but because it is 
what is in the law that we enacted and that needs to be enforced. 
And ESSA is clear: it is the responsibility of the Department to re- 
view and provide feedback on ESSA State plans, make determina- 
tions of approvals, of disapprovals, based on compliance with the 
statute and partner, including through enforcement activities, with 
States and school districts to support the laws’ implementation 
moving forward. 
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It is the responsibility of States and districts to innovate within 
the guardrails of ESSA’s equity requirements. There may have 
been a change in administration, but the law is the law and the 
Federal role is clear. I hope this committee commits to a robust 
oversight of ESSA implementation moving forward to ensure that 
it is responsibly fulfilled. 

Thank you, Madam Chair, and I yield back. 

[The statement of Mr. Scott follows:] 


Prepared Statement of Hon. Robert C. “Bobby” Scott, Ranking Member, 
Committee on Education and the Workforce 


Thank you, Chairwoman, for convening this morning’s hearing on implementation 
of the Every Student Succeeds Act. I’d also like to thank today’s witnesses for ap- 
pearing before us today. I look forward to hearing from each of you. 

It is regrettable; however, that we are not hearing from the US Department of 
Education, especially considering media reports of the majority’s intention to cri- 
tique its implementation actions during today’s proceedings. I know I, for one, would 
greatly benefit from an open dialogue with the Department — on ESSA and on other 
matters. 

Chairwoman Foxx, you may remember that I sent you a letter urging Secretary 
DeVos and the other agency heads to appear before the committee to discuss the 
administration’s priorities. That request has not been fulfilled, so I would like to 
take this opportunity to again ask that Secretary DeVos, or another representative 
of the Department appear to engage in an open dialogue with this committee. 

ESSA has been the law of the land for nearly 20 months, and while that may 
seem like a long time, in the lifecycle of a law as consequential as the Elementary 
and Secondary Education Act, it really is just the beginning. States are only just 
now undergoing the peer review and plan approval process, following months of 
work amidst a regrettably chaotic regulatory environment. 

I said this in February and March, but it bears repeating: I believe this Congress’ 
use of the CRA to block regulation of Title I’s core requirements was misguided and 
irresponsible. But counter to the bipartisan agreement of ESSA, this body did move 
forward with the CRA - and that is now the reality to which we must all adjust. 
Lack of regulation means increased subjectivity in determining compliance with the 
law’s requirements, which makes the oversight actions of this Committee even more 
important. 

This increased subjectivity without appropriate regulation is apparent in the De- 
partment’s early feedback on state plans that were submitted in the May submis- 
sion window. Plan components praised by peer reviewers in one state’s plan were 
questioned as insufficient in another’s, while other violations of ESSA’s equity re- 
quirements are ignored by the Department completely. 

I am disappointed with the reaction from some of my colleagues in the majority 
who have characterized ED’s state plan feedback as overreach. 

Despite the soaring rhetoric, ESSA is not a blank check to states and districts. 
While the law affords states and districts much flexibility in decision-making, that 
flexibility must occur within the guardrails of the law — including guardrails con- 
cerning the integrity of assessments to ascertain persistent achievement gaps and 
act to close them. Congress designed the law’s guardrails to protect the interests of 
underserved students. 

The law contains important requirements — requirements Republicans and Demo- 
crats all agreed to when we voted for ESSA — and those requirements must be 
meaningful. ESSA is not — and never has been — a free for all, and it is the responsi- 
bility of the Department, as articulated by Congress in ESSA, to carefully scrutinize 
the quality of state plans and only approve those that meet the law’s requirements. 

Even without accompanying regulations, the law is the law — and the law requires 
the Secretary to review plans, ask hard questions and disapprove if necessary — in 
the interest of students. 

While, as I just mentioned, I find some of the content and the overall inconsist- 
ency of the Department’s feedback to be problematic, I do not — and none of us 
should — take issue with the Department attempting to do its job. The feedback 
must be more consistent and more rigorous, not less rigorous. And ultimately, the 
feedback and resubmission of plans must result in approval only of plans that meet 
the spirit and letter of the law. 


7 


As we will hear today, many state plans leave much to be desired, either due to 
ambiguity or incompleteness in response or due to proposed plan components that 
violate the law’s equity requirements. It is my hope that the 

Department will work with states, including through provision of adequate guid- 
ance and technical assistance, to improve the overall quality of state plans and en- 
sure implementation that honors the longstanding civil rights focus of the ESEA. 

Such implementation is only possible with the support and partnership of the fed- 
eral government. Not only is it the role of the Department to support and monitor 
state efforts to comply with the law, but it is also the role of Congress to fund pro- 
grams authorized by ESSA. 

Despite promises to implement the law as Congress intended, Secretary DeVos 
and President Trump proposed elimination of bedrock ESEA programs — Title II- 
A to support teachers, 21st Century Community Learning Centers to support after 
eboe) — and cuts to others, including an effective cut of nearly $600 million to Title 
I-A. 

And while the House Majority’s FY18 LaborH appropriations bill isn’t as draco- 
nian as the President’s budget request, it fails to honor the bipartisan agreement 
of ESSA by eliminating Title I-A, cutting afterschool, and maintaining the effective 
cut to Title I-A that will be felt at the local level. Elimination of Title I-A would 
result in thousands of layoffs and inhibit local and state efforts to improve teacher, 
paraprofessional, and school leader supports — defunding this program most cer- 
tainly does not align with the bipartisan intent of the authorizing statute. 

Lastly, Trumpcare’s proposed cuts to Medicaid, if enacted, will devastate services 
for students with disabilities and undermine state and local efforts to educate all 
students to high standards, as required by ESSA. 

How effective can an implementation be without funding? I know all too often 
that state and local educational agencies face capacity challenges, and I hope to 
hear from today’s witnesses about the negative impact of underfunding ESSA pro- 
grams on faithful implementation. 

In closing, I remain concerned with many of the actions of Secretary DeVos and 
this administration concerning our nation’s students — 

* the recent rhetoric from OCR and the office’s directive to ignore systemic data 
in investigating alleged civil rights violations; 

* the lack of agency capacity to carry out key department functions; 

* the rollbacks of protections for student borrowers; 

* rescinding protections for transgender students; and 

* the sledgehammer-like approach to deregulation without transparency of deci- 
sion-making at the department... 

All of these actions point to a troubling pattern that undermines the federal gov- 
ernment’s important role to protect and promote the civil rights of all students. 

This pattern must not continue with ESSA implementation. I say that not out of 
wishful thinking or partisan spin, but because that’s what the law we wrote and 
enacted demands. 

ESSA is clear — it is the responsibility of the Department to review and provide 
feedback of ESSA state plans, make determinations of approval or disapproval 
based on compliance with statute, and partner, including through enforcement ac- 
abe with states and school districts to support the law’s implementation moving 

orward. 

And it is the responsibility of states and district to innovate within the guardrails 
of ESSA’s equity requirements. There may have been a change in administration, 
but the law is the law and the federal role is clear. I hope this committee commits 
to robust oversight of ESSA implementation moving forward to ensure that respon- 
sibility is fulfilled. 

Thank you and I yield back. 


Chairwoman Foxx. Thank you, Mr. Scott. Pursuant to committee 
rule 7C all members will be permitted to submit written state- 
ments to be included in the permanent hearing record. Without ob- 
jection, the hearing record will remain open for 14 days to allow 
such statements and other extraneous material referenced during 
the hearing to be submitted for the official hearing record. 

I now turn to introductions of our distinguished witnesses. Ms. 
Jacqueline Nowicki is the director of K-12 education for the U.S. 
Government Accountability Office. Dr. Gail Pletnick is the super- 
intendent for the Dysart Unified School District in Surprise, Ari- 
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zona. Mr. Phillip Lovell is vice president of policy development and 
government relations at the Alliance for Excellent Education. Dr. 
Carey Wright is the superintendent of education for Mississippi. 

I now ask our witnesses to raise your right hand. 

[Witnesses sworn. ] 

Chairwoman Foxx. Let the record reflect the witnesses answered 
in the affirmative. 

Before I recognize each of you to provide your testimony, let me 
briefly explain our lighting system. We allow 5 minutes for each 
witness to provide testimony. When you begin, the light in front of 
you will turn green. When 1 minute is left, the light will turn yel- 
low. At the 5-minute mark the light will turn red and you should 
wrap up your testimony. Members will each have 5 minutes to ask 
questions. 

We now recognize Ms. Nowicki for 5 minutes. 


TESTIMONY OF JACQUELINE NOWICKI, DIRECTOR, K-12 
EDUCATION, U.S. GOVERNMENT ACCOUNTABILITY OFFICE 


Ms. NowICcKI. Good morning, Chairwoman Foxx, Ranking Mem- 
ber Scott, and members of the committee. I appreciate the oppor- 
tunity to discuss GAO’s new report on early observations on State 
accountability systems under ESSA. As you well know, ESSA re- 
quires States to have accountability systems that meet certain re- 
quirements, but grant States flexibility in designing these systems. 

We focused our work on four areas of State accountability sys- 
tems: one, determining long-term goals; two, developing perform- 
ance indicators; three, differentiating schools; and four, identifying 
and assisting low performers. We did so because stakeholder 
groups identified these as key components of accountability sys- 
tems under ESSA and as areas in which States are making 
changes. 

My remarks today will focus on two key areas. First, Ill discuss 
stakeholder views on ESSA’s flexibilities to redesign accountability 
systems. Second, I'll discuss next steps for the Department of Edu- 
cation in implementing ESSA. 

In regards to my first point, all nine national stakeholder groups 
with whom we spoke saw ESSA’s accountability provisions as 
somewhat flexible. For example, most of them praised the ability 
to define their own performance indicators. 

Most stakeholders also indicated that ESSA strikes a good bal- 
ance between flexibility and requirements. For example, one stake- 
holder said that ESSA threads the needle very well between offer- 
ing flexibility to design systems that meet State needs and requir- 
ing States to protect vulnerable populations. 

The extent to which States are changing their current systems 
varies. Some States are pleased with the systems they developed 
under their NCLB waivers and are continuing down that path. But 
for States that see their current systems as lacking in some way 
or when stakeholder consultation highlighted the need for signifi- 
cant change, we were told that ESSA provides room for States to 
consider innovative revisions. 

Our report provides many examples of how two States, Ohio and 
California, are tailoring their accountability systems of each of the 
four areas I mentioned. I would like to highlight one example here. 
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To address ESSA’s requirements to differentiate schools, Ohio 
plans to tweak its six current indicators to assess school and stu- 
dent performance. Some of these indicators would measure current 
performance while others would measure growth. 

And schools would receive a letter grade on each indicator as 
well as an overall letter grade. Ohio officials felt that this approach 
would provide detailed information on various elements of their 
performance system as well as provide an easily understandable 
high-level overview of performance. 

In California, the plan is to use a color-coded dashboard to dif- 
ferentiate school and students’ subgroup performance on each of six 
indicators. Each indicator will measure current performance as 
well as growth over time. 

Unlike Ohio, California does not plan to aggregate the indicators 
into an overall score. State officials said they chose not to aggre- 
gate because they feel that doing so can mask individual problem 
areas. They also told us that measuring current performance and 
growth for each indicator provides a more complete picture of per- 
formance. 

With regard to my second point, given current timelines, the De- 
partment of Education remains focused on providing assistance to 
States in developing their plans and on the review and approval 
process for plans. Moving forward a key next step in ESSA imple- 
mentation is for the Department to develop and implement State 
monitoring protocols. Although draft protocols were not available at 
the time of our review, education officials said that they planned 
to pilot protocols with eight or nine States in early 2018. 

The Department’s goal is to review all States within a 3- to 4- 
year cycle. Education officials also told us that they are considering 
whether there is a need for additional guidance for States. During 
our review, most national stakeholder groups told us that States 
could use guidance on a number of issues such as how to identify 
and evaluate appropriate evidence-based interventions. 

In closing, I hope our early observations shine some light on how 
States are thinking about their accountability systems in the con- 
text of ESSA’s flexibilities. ESSA implementation is still in the 
early days and much work lies ahead for both States and the De- 
partment of Education before the promise of ESSA can be fully re- 
alized. 

We look forward to working with you to support your efforts to 
oversee implementation of this important law. This completes my 
prepared remarks. I would be pleased to answer any questions you 
may have. 

[The statement of Ms. Nowicki follows:] 
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Chairwoman Foxx, Ranking Member Scott, and Members of the 
Committee: 


| am pleased to be here to discuss our report on early observations on 
changes some states are making to their K-12 accountability systems in 
reaction to the Every Student Succeeds Act of 2015 (ESSA).' As you 
know, accountability systems measure student and school performance 
and provide information on that performance to key stakeholders — 
parents, teachers, government officials, and taxpayers. As a condition of 
receiving federal education funds for school districts with high 
concentrations of students from low-income families, ESSA requires 
states to have accountability systems that meet certain requirements, but 
grants states flexibility in designing these systems. ESSA’s provisions 
regarding accountability systems generally take effect beginning with 
school year 2017-2018. In general, ESSA requires states to measure the 
performance of their schools and use those measures to identify 
underperforming schools and student subgroups for additional 
assistance, 


My remarks today are based on our recent report entitled Every Student 
Succeeds Act: Early Observations on State Changes fo Accountability 
Systems.* Accordingly, this testimony addresses (1) selected 
stakeholders’ and states’ views of ESSA’s flexibilities to redesign 
accountability systems and (2) the U.S. Department of Education’s 
(Education) next steps in implementing ESSA. To gain insight into these 
issues, we interviewed representatives of nine prominent national 
education stakeholder groups knowledgeable about accountability 
systems, six of which worked directly with states as they revised their 
accountability systems in response to ESSA. We also visited state 
educational agencies, school districts, and a total of four state 
stakeholder groups in California and Ohio. We selected California and 
Ohio because they were among the states that national stakeholder 
groups cited as being illustrative of different state approaches to 


‘ ESSA, enacted in December 2015, reauthorized the Elementary and Secondary 
Education Act of 1965 (ESEA), Pub. L. No. 114-95, 129 Stat. 1802 (2015). Accountability 
systems were also required under the previous reauthorization, the No Child Left Behind 
Act of 2001. 


2 GAO, Every Student Succeeds Act: Early Observations on State Changes to 
Accountability Systems. GAO-17-660, (Washington, D.C.: July 18, 2017) 


Page? GAQA7-787T 
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developing their proposed accountability systems. We also interviewed 
Education officials and reviewed relevant federal laws and Education 
guidance pertaining to ESSA accountability provisions. Lastly, we 
reviewed accountability system guidance from California and Ohio as well 
as relevant portions of their draft state plans which describe how they 
plan to comply with ESSA accountability requirements. Additional 
information on our scope and methodology is availabie in our full report. 
We conducted this performance audit from December 2016 to July 2017 
in accordance with generally accepted government auditing standards. 


in our report we focused on 4 components of accountability systems 
under ESSA that we identified during interviews with national 
stakeholders as being key components of these systems and as areas 
where states are making changes to these systems (see Figure 1). 


Figure 1: Four Key Components of Accountability Systems Under the Every Student Succeeds Act (ESSA). 


€% Determine long-term goals 
ESSA requires states to establish multiple ambitious, 
state-designed fong-term goals, including goals 
for all students and each subgroup of students 
“SB . _ for improved academic achievement, and include 
Every Ae measurements of interim progress 
Student ce toward those goals? 
Succeeds 
Act (ESSA) 
accountability 
fol abe 2 system 
©) Differentiate schools @® oO @ 
ESSA requires states to establish a system 
for meaningfully differentiating the performance 
of its schoals, based on the state's indicators. 


€h identify and assist low-performers 
ESSA requires states to Identify a number of 
categories of schools, including low-performing schools 
and schools in which student subgroups are consistently 
underperforming, and implement comprehensive or 
targeted support and improvement plans to improve 
student outcomes for those schoois. 


&) Develop performance indicators 
ESSA requires states to annually measure schools’ 
performance on multiple indicators based on states’ 

long-term goals. ESSA allows states to select a 

range of indicators, within federal parameters. 


j 
iy 
ig 
Ei 


Source: GAO analysis of Every Student Succeeds Act (ESSA) accountability system requirements, | GAQ-17-757T 
Note: This figure is intended to provide a high-level summary of selected campanents of state 
accountability systems as required by ESSA. For additional information on these components, See 20 
U.S.C. § 6311(c) and (d). ESSA's provisions related to state accountability systems do not become. 


effective until school year 2017-2018, 
“Student subgroups include economically disadvantaged students, students from major racial ethnic 
groups, children with disabilities, and English learners. 
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Stakeholders and 

Selected States View 
ESSA’s Accountability 
Provisions as Flexible 


Representatives of all nine national stakeholder groups we spoke with 
saw ESSA’s accountability provisions as somewhat flexible, with most 
indicating that ESSA strikes a good balance between flexibility and 
requirements. One stakeholder said, for example, that ESSA “threads the 
needle very well” between giving states flexibility in designing their 
accountability systems and placing requirements on states to help ensure 
that all children have access to a good education. Most stakeholders also 
mentioned ESSA provisions related to developing performance indicators 
as an example of flexibility. One stakeholder, for example, saw, these 
provisions as flexible because they allow states to define the exact 
indicators they will use, including indicators that measure student growth 
in addition to student proficiency when assessing academic performance. 


Some states are using ESSA’s flexibilities to significantly change their 
accountability systems while others are making more limited changes. 
Representatives of four national stakeholder groups that have worked 
directly with states to help them develop and revise their accountability 
systems told us that the extent to which states are revising their 
accountability systems varies because some states are satisfied with their 
current systems and others are using the flexibilities in the law to make 
significant overhauls. According to representatives of one stakeholder 
group, many states already began revising their accountability systems as 
a result of waivers Education granted under the previous reauthorization 
of ESEA, the No Child Left Behind Act of 2001 (NCLBA).° They further 
said that ESSA is generally flexible enough for states to continue down 
the path they started in implementing their NCLBA waivers. In addition, 
representatives of several stakeholder groups mentioned that for states 
that see their current accountability systems as lacking in some way, or 
because consultation with state stakeholders has pointed to the need for 
significant change, ESSA provides room for them to consider innovative 
revisions. 


Ohio and California illustrate how two different states are using the 
flexibilities in ESSA to tailor their accountability systems to meet state 
needs for each of the four key components of state accountability 
systems. To illustrate the different approaches each state is taking, | offer 
the following examples related to developing performance indicators. 


3 For more information about these waivers, see our report, GAOQ-17-660, 
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Under ESSA, states are required to measure four indicators related to 
academics for all students and subgroups and at least one Indicator of 
school quality or student success. The following examples from Ohio and 
California illustrate how each state is adapting its performance indicators 
to meet the requirements of ESSA and various needs in each state. 


« In Ohio, state officials said they plan to use chronic absenteeism as 
an indicator of school quality or student success. They said they have 
studies that show that school attendance is strongly correlated with 
successful student performance. Because the state already collects 
attendance data, officials said this indicator would reduce the need for 
additional data collection. Ohio officials and stakeholders in the state 
said that ESSA has prompted many substantive conversations about 
what to use for the school quality or student success indicator. For 
example, Ohio stakehalders and a school district official in Ohio have 
raised concerns about using chronic absenteeism as a measure 
because schools and districts cannot control whether students come 
to school. State officials said that in response to these concerns, 
Ohio’s draft plan now includes a commitment to pilot a survey of 
students known as a “school climate survey” for potential inclusion as 
an additional indicator of school quality or student success in future 
years, 


« California proposes to use chronic absenteeism as an academic 
indicator but not an indicator of school quality or student success—~as 
proposed in Ohio. California’s draft plan notes a correlation between 
strong academic performance and school attendance. For the school 
quality or student success indicator, California plans to measure the 
number of suspensions in a school or district, with high suspension 
rates indicating poor quality and failure, and low rates indicating 
success. State officials said that ESSA flexibilities allowed them to 
differentiate what was considered high and low rates of suspension by 
grade level (i.e., elementary, middle, and high school). They explained 
that this is important because it allows them to tailor the indicator for 
each level. 


Developing and 
implementing State 
Monitoring Plans is a Key 
Next Step for Education in 
Implementing ESSA 


Education officials said their next steps in implementing ESSA are to 
review and approve state plans and to continue to provide technical 
assistance to states. As of May 2017, 16 states and the District of 
Columbia had submitted their plans to Education for review; the 
remaining plans are due by September 18, 2017, according to 
Education’s guidance. Both states we visited as part of our review intend 
to submit their plans by the September deadline. 
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Education officials also told us they are determining whether there is a 
need for additional guidance to states on aspects of ESSA 
implementation. Our report provides more information about Education's 
technical assistance efforts, including webinars on state plan 
development and on the peer review process. Education has also 
implemented a technical assistance initiative called the State Support 
Network to support state and district school improvement efforts under 
ESSA. 


Education officials said that they are developing monitoring protocols for 
in-depth reviews of states’ ESSA-related activities and will pilot them in 
early 2018. These protocols are intended to guide in-depth reviews of 
state activities related to ESSA implementation. Officials told us that 
Education used similar in-depth state reviews when developing past 
monitoring protocols, reviewing a select number of states each year with 
the goal of reviewing all states within a 3- to 4-year cycle. 


Chairwoman Foxx, Ranking Member Scott, and Members of the 
Committee, this concludes my prepared remarks. | look forward to 
answering any questions you may have. 


For further information regarding this testimony, please contact Jaqueline 
M. Nowicki at (617) 788-0580 or nowickij@gao.gov. Contact points of our 
Offices of Congressional Relations and Public Affairs may be found on 
the last page of this statement. Individuals who made key contributions to 
this testimony include, Bill Keller (Assistant Director), Melinda Bowman 
(Analyst-in-Charge), Nancy Cosentino, James Bennett, Sarah Cornetto, 
Anna Dunean, Holly Dye, Sheila R. McCay, and Monica Savoy. 
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Chairwoman Foxx. Thank you, Ms. Nowicki. 
Dr. Pletnick, you are recognized for 5 minutes. Would you turn 
on your microphone, please? 


TESTIMONY OF GAIL PLETNICK, SUPERINTENDENT, DYSART 
UNIFIED SCHOOL DISTRICT 


Ms. PLETNICK. Thank you. Chairman Foxx, Ranking Member 
Scott, members of the committee, thank you for this opportunity to 
join you today. I am the superintendent of the Dysart School Dis- 
trict in Arizona, and I also serve as president of AASA, the school 
superintendent association. 

I am here today because I believe it is critical we continue to 
work together to ensure the underserved populations in our schools 
truly benefit from the educational promise that the Every Student 
Succeeds Act, ESSA, was designed to deliver. I thank you and the 
committee for convening this ESSA hearing. 

The House of Representatives and the Senate are to be ap- 
plauded for the hard work that was done to craft ESSA moving 
from the one-size-fits-all of No Child Left Behind to restoring con- 
trol of education to the States and the local communities. Although 
ESSA may not be perfect, the power of the law is the flexibility it 
provides to States and schools allowing the focus to be on the indi- 
vidual student. 

I have the opportunity to talk with superintendents from across 
the State of Arizona and across the Nation about the progress 
made in ESSA implementation. A common thread in those con- 
versations is that ESSA has created an opportunity for stake- 
holders to become more involved in goal-setting and establishing 
accountability processes as part of the consolidated plan require- 
ment of ESSA. 

ESSA requires efforts to consult with and engage stakeholders 
when developing a consolidated State plan. In Arizona, committees 
and advisory groups were established to provide input at various 
stages of the plan development, feeding input into the process of 
building a final consolidated plan. I had the privilege of partici- 
pating in some of these established subgroups and I also attended 
public meetings designed to provide comment on proposed compo- 
nents in the plan. 

I am not going to tell you that Arizona has developed the ideal 
educational plan for our State. There is definitely room for contin- 
ued improvement as we implement ESSA, see what works, and 
continue to rollback State policies that lock in NCLB error con- 
straints. Stakeholders are engaged in conversation around the 
needs in our educational systems, a discussion that is important to 
driving the improvement necessary to provide an equitable quality 
education to each student. 

A second promise of ESSA statute that many States are realizing 
is the ability to utilize multiple indicators for evaluation of our 
schools. In Arizona, we still rely heavily on annual summative 
tests, but the flexibility in ESSA started a conversation about other 
meaningful measures that should be considered. Although not 
without faults, the revised accountability system in Arizona at- 
tempts to add indicators of significance. And that is something that 
we continue to look forward to improving. 
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At the high school level, indicators incorporated include career 
and technical education assessments, advanced academic 
coursework indicators, and earned career credentials. The State’s 
elementary level measures of accountability are far more restric- 
tive, but conversation in the State of Arizona continues around ex- 
ploring additional important measures. While we don’t have it 100 
percent right in Arizona just yet, I can say the flexibility in ESSA 
around State accountability systems does encourage conversation 
among stakeholders about more accurate indicators of student and 
school success. 

There were challenges with the implementation of ESSA law. 
Time was definitely one of the biggest challenges. After the passage 
of the law, there was discussion related to the interpretation of the 
law and possible or proposed regulations and that debate caused 
some hesitation. 

Arizona released its first draft and started the consolidated plan- 
ning process in September of 2016, and the plan required adjust- 
ments before our submission for the September 2017 deadline. An- 
other complication as it related to time is that some States, includ- 
ing Arizona, had laws in place better aligned to No Child Left Be- 
hind mandates or waivers. With those State laws still in existence, 
there was an impact on what was required in our State plan and 
accountability system. 

Although that is not a Federal concern, it does impact how inno- 
vative our State plans may be at this point. A great deal of time 
and effort went into Congress writing this piece of legislation and 
negotiating on those critical components that make ESSA a good 
piece of educational legislation. 

The ultimate success of ESSA lies in our implementation, yes, 
but also in Federal appropriations. It is critical Congress match the 
bipartisan support demonstrated for the policy of the law and ap- 
propriate the funding support. 

I respectfully submit that as we continue to work together to im- 
plement ESSA and ensure it has the intended impact that we be 
cognizant of the important complementary role of adequate Federal 
investment. The students in our schools are our future leaders, our 
future workforce, and we must invest in our future by investing in 
public education. 

In closing, thank you to the committee for the work you have 
done and continue to do to ensure that the Every Student Succeeds 
Act drives the change we all want to see in our schools: equity in 
our classrooms regardless of a student’s background, where they 
live, or the circumstances they live in. Your work has ensured our 
State and local communities have a voice in what happens in our 
districts and our schools. 

I know, given the opportunity, educational leaders across this 
country will use that voice to deliver on the promise of ESSA. 
Thank you so much. 

[The statement of Ms. Pletnick follows:] 
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eens My name is Gail Pletnick and | am the Superintendent of the Dysart Unified 


www.dysartore Schoo! District in Arizona and serve as the President of AASA, The School 
Superintendents Association. | am here today because | believe it is critical we 
continue to work together to ensure the underserved populations in our schools 
truly benefit from the educational promise that the Every Student Succeeds Act 
(ESSA) was designed to deliver. | thank you and the committee for convening this 
ESSA hearing, a continuation of the hearings held in the last Congress. 


The House of Representatives and the Senate are to be applauded for the hard 
work that was done to craft the Every Student Succeeds Act (ESSA), moving from 
the “one size fits all” mandates of No Child Left Behind (NCLB) to restoring control 
of education to the states and local communities. Although ESSA may not be 
perfect, the power of the law is the flexibility it provides to states and schools 
allowing the focus to be on the individual student. ESSA returned responsibility 
for education to the state and local levels, allowing better tailored consolidated 
plans to achieve the promise that every student, including our underserved 
populations, succeed in obtaining a quality education that ensures they are future 
ready, 


| have had the opportunity to talk with superintendents from across the state of 
Arizona and from across the nation about the progress made in ESSA 
implementation. A common thread in those conversations is that ESSA has 
created an opportunity for stakeholders to become more involved in goal setting 
and in establishing accountability processes as part of the consolidated plan 
requirement in ESSA. ESSA requires established procedures and criteria for 
consultation with the state Governor, State Education Agency, but also, requires 
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incorporated in the state’s revised accountability system. The flexibility of ESSA 
resulted in a more inclusive process for identifying educational goals at the state 
fevel and for building the evaluation systems to measure progress. | believe this 
more inclusive approach will enhance transparency at the state and federal 
levels. 


1am not going to say Arizona has developed the ideal educational plan for our 
state; there is definitely room for continued improvement as we implement ESSA, 
see what works, and continue to roll back state policies that lock in NCLB-era 
constructs, Stakeholders are engaged in conversation around needs in our 
educational systems, a discussion that is important to driving the improvements 
necessary to provide an equitable quality education to all students, including our 
underserved populations. Later in this statement, | will share some challenges 
that | believe impacted the ability for Arizona to produce a more robust 
consolidated pian and those issues may also have impacted efforts in other 
states. 


A second promise of the ESSA statute that many states are realizing is the ability 
to utilize multiple indicators for evaluation of our schools. ESSA requires 
evaluation of schools on academic and non-academic factors, but did not 
mandate a single indicator. in Arizona we still rely heavily on annual summative 
test scores in English language arts and math, but the flexibility in ESSA started a. 
conversation about other meaningful measures that should be considered. 
Although not without faults, the revised accountability system in Arizona 
attempts to add indicators of significance and that is something we look forward 
to improving. At the high school level indicators incorporated include Career and 
Technical Education assessments, advanced academic coursework indicators and 
earned career credentials. The state’s elementary level measures of 
accountability are far more restrictive, but conversation in the state of Arizona 
continues around exploring additional important measures. While we don’t have 
it 100% right in Arizona just yet, | can say the flexibility in ESSA around state 
accountability systems does encourage conversation among stakeholders about 
exploring multiple measures and more accurate indicators of student and thus 
school success. ESSA gave the states the flexibility to utilize current research, 
technology, and the flexibility of the law to build much stronger accountability 
and reporting systems with meaningful multiple indicators. States were tasked to 
take responsibility for building a transparent and fair accountability systems and | 
believe that stakeholders are willing to take on that task in earnest. 


There were challenges with the implementation of the ESSA law. Time was 
definitely one of the biggest challenges. After the passage of the law, there was 
discussion related to the interpretation of the law and possible or proposed 
regulations. That debate caused some hesitation in design elements of the 
consolidated plans at the state and local levels. Arizona started the consolidated 
planning process in September of 2016 and the plan has had to be adjusted 
several times before our anticipated submission in September 2017. Consistency 
in how ESSA is interpreted and regulated is critical. Uncertainty created by 
shifting interpretations of the ESSA law continues to be a concern. The issue is 
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that the intent of this law may be lost in transtation and will result in 
inconsistencies that create greater inequalities. We need ta allow ESSA to speak 
directly to the work that must be done in implementing the law and not allow 
interpretation to move the target set in ESSA of every student succeeding. 
Respectfully, | ask Congress to guard against over reach. 


Another complication, as it related to time is that some states, including Arizana, 
had laws in place better aligned to NCLB mandates or waivers, With those state 
laws still in existence there was an impact on what was required in a state plan or 
accountability system. For example, in Arizona an A-F system is required and thus 
that framed the discussion and decisions made regarding the consolidated plan 
and the accountability system. Although that is not a federal concern, it does 
impact how innovative state plans may be as they are developed. 


A final point | want to make is that a great deal of time and effort went into 
Congress writing this piece of legislation and negotiating on those critical 
components that make ESSA a good piece of education legislation. The 
authorizing language is only one half of the story, though. The ultimate success of 
ESSA lies in our implementation, yes, but also on federal appropriations. It is 
critical Congress match the bipartisan support demonstrated for the policy of the 
law with appropriate funding support. | want to take a direct quote from the AZ 
Consolidated Plan: “As Arizona continues, through both federal and state funds, 
to fine tune funding streams for our LEAs, the committee felt it important to 
recognize the need for consistent funding. Through consistent and reliable 
funding, innovative strategies to support all learners can be developed and 
sustained. Additionally, consistent and reliable funding assists LEAs in building a 
strong cadre of teachers and leaders to fully support learners within our Arizona 
schools and to accelerate the closing of proficiency gaps.” 


| respectfully submit that as we continue to work together to implement ESSA and 
ensure it has the intended impact, that we be cognizant of the important 
complementary role of adequate federal investment. The students in our schools 
are our future leaders, our future workforce, and we must invest in our future by 
investing in public education. 


In closing, thank you to the Committee for the work you have done and continue 
to do to ensure the Every Student Succeeds Act drives the change we all want to 
see in our schools - equity in our classrooms regardless of a student's 
background, where they five or the circumstances they Jive in. Your work has 
ensured our states and focal communities have a voice in what happens in our 
districts and schools. { know, given the opportunity, educational leaders across 
this country will use that voice to deliver on the promise of ESSA. 


Thank you. 

Gail Pletnick, Ed.D. 
Superintendent 
AASA President 
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Chairwoman Foxx. Thank you, Dr. Pletnick. 
Mr. Lovell, you’re recognized for 5 minutes. 


TESTIMONY OF PHILLIP LOVELL, VICE PRESIDENT OF POLICY 
DEVELOPMENT AND GOVERNMENT RELATIONS, ALLIANCE 
FOR EXCELLENT EDUCATION 


Mr. LOVELL. Thank you very much. Chairwoman Foxx, Ranking 
Member Scott, and members of the committee, thank you for the 
opportunity to testify on the implementation of the Every Student 
Succeeds Act. My name is Phillip Lovell and I am the vice presi- 
dent for policy development and government relations at the Alli- 
ance for Excellent Education. We are a national nonprofit organiza- 
tion dedicated to ensuring that every child graduates from high 
school, ready for college, career, and citizenship. 

I have four core messages for you today. First, ESSA is a civil 
rights law designed to ensure equity and excellence in education. 
Second, ESSA preserves an important role for the U.S. Department 
of Education. Third, the quality of ESSA State plans is uneven. 
And fourth, funding cuts threaten the implementation of the law. 

Let me begin with point one. ESSA is fundamentally a civil 
rights law with many Federal requirements designed to promote 
educational equity and prepare students for postsecondary edu- 
cation and the workforce. ESSA provides States with a significant 
level of flexibility when it comes to how they achieve equity and ex- 
cellence, but ESSA is not a blank check. 

Both States and the Department of Education must implement 
and enforce all of ESSA’s equity-focused requirements, a sample 
list of which appears in my written testimony. 

Second, when Congress enacted ESSA it preserved the limited 
but critical role of the Department of Education. While I may not 
agree with all of its findings, the Department is appropriately car- 
rying out its oversight role as required under the law. I want to 
be clear that this isn’t about whether we trust States. I have 
worked with many State leaders and I know that they are com- 
mitted to kids, and one needs to look no further than my colleagues 
testifying today to know that is a fact. 

The fact does remain, though, that it is the Department’s job to 
review the State plans and to ensure that they comply with the law 
that this committee wrote. These plans lay out a State’s vision and 
commitment to children, parents, and the public, and it will impact 
students and teachers for at least the next decade. We have to get 
this right and the Department has a critical and statutorily re- 
quired role to play. 

Third, the quality of ESSA State plans is uneven. There are cer- 
tainly some strengths, but there are missed opportunities and 
many weaknesses, including some proposals that simply violate the 
ae particular, many plans fall short of the equity promise of 
E ; 

And let me give you a few examples. ESSA made a commitment 
that if a school has a single subgroup that consistently underper- 
forms, either the African American students, Latino students, the 
school would be identified for targeted support and those kids 
would receive help. ESSA applies this requirement to each indi- 
vidual subgroup separately because groups of students perform dif- 
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ferently. And if you combine them together you can mask the low 
performance of a single group. 

Unfortunately, this is exactly what some States are doing. One 
State combines the achievement levels of African American, Latino, 
and native students together even though this creates a risk that 
the schools may not be identified for support when they should be. 
It also violates the law. 

A related but distinct problem is that States are not including 
historically underserved kids in their school ratings. For example, 
a school might receive an A despite the fact that African American 
students or Latino students or students with disabilities or low-in- 
come kids, other historically underserved groups might have, say, 
a low graduation rate. So you can receive an A even though, say, 
African American kids could have a graduation rate of 60 percent. 

Another problem for equity in ESSA plans relates to the identi- 
fication of subgroups for support. Several States have proposed 
identifying subgroups for support if they aren’t on grade level in 
math or reading or if they have a low graduation rate, and this 
makes a lot of sense. Unfortunately, the Department has actually 
pushed back on this approach. Students should not have to fail on 
everything before they are identified for support. 

In addition, it is worth noting that while ESSA’s flexibility was 
intended to unleash creativity and innovation, by and large this 
has not happened. We hope to see policies that would promote crit- 
ical thinking and problem-solving, sometimes called deeper learn- 
ing. And although there are a few notable exceptions described in 
my written testimony, and here to my left I would say, State plans 
thus far are cautious, not courageous. 

Finally, I join my colleagues in expressing concerns about fund- 
ing. Money is not magic, but I am concerned about the impact of 
funding cuts on ESSA. ESSA provides States with flexibility and 
responsibility. But, Madam Chair, responsibility without resources 
will not yield results. 

By freezing funding for title I, underfunding title IV, proposing 
to eliminate or reduce funding for professional development, lit- 
eracy, afterschool programs, on top of proposed cuts to Medicaid 
that jeopardize the services that schools provide to our most vul- 
nerable kids, we are handcuffing States at the exact moment that 
we have supposedly given them freedom. 

This is unfortunate because the Nation is on an upswing in edu- 
cation. Graduation rates are at an all-time high, including gradua- 
tion rates for students who have been historically underserved. By 
implementing and enforcing ESSA’s requirements and strength- 
ening our investment in education, we can ensure that every child 
in American succeeds. 

Thank you, and I would be happy to answer any questions. 

[The statement of Mr. Lowell follows:] 
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Chairwoman Foxx, Ranking Member Scott, Members of the Committee, thank you for the 
opportunity to testify on the implementation of the Every Student Succeeds Act (ESSA). My 
name is Phillip Lovell and I am vice president of policy development and government relations 
at the Alllance for Excellent Education, a nonprofit organization dedicated to ensuring that every 
child graduates ready for college, a career, and citizenship. 


This is an important hearing to hold as states develop and finalize their plans to implement 
ESSA. Having reviewed the state plans submitted to the U.S. Department of Education (ED), and 
currently working with states that plan to submit in September, I'd like to discuss with the 
Committee four core themes that are important to reflect upon as ESSA implementation is 
analyzed: 


|. ESSA isa civil rights law with equity-focused requirements that must be implemented and 
enforced. 


bh 


ESSA preserves the limited but critical role of the federal government. While | may not agree 
with all of its findings, | appreciate that ED is carrying out its oversight role as required 
under the law in its letters to states responding to proposed ESSA plans. 


3. The quality of ESSA state plans is uneven. There are certainly some strengths, but there are 
missed opportunities and many weaknesses, including proposals that are inconsistent with the 
law. 


4, Proposed funding cuts jeopardize ESSA implementation. 
ESSA’s Equity-Focused Requirements 


ESSA is fundamentally a civil rights law with many federal requirenients designed to promote 
educational equity and prepare all students for postsecondary education and the workforce. 
ESSA provides states with significant flexibility when it comes to how they achieve equity and 
excellence, but ESSA is not a blank check. Both states and ED must implement and enforce all 
of ESSA's equity-focused requirements. See Appendix A for specific examples of these 
requirements. 


There have been positive results when the federal government has focused on equity in 
education. For example, ED has been a driving force in the improvement of the nation’s high 
school graduation rate by implementing federal regulations issued under the administration of 
President George W. Bush to get schools, districts, and states to focus on the problem, set 
graduation rate goals, and hold themselves accountable over time for achieving them. According 
to the 2017 Building a Grad Nation report, the national high school graduation rate is at an all- 
time high. All told, 2.8 million more students have graduated from high school since 2001 and 
gaps in graduation rates between groups of students have narrowed,! 


' For more information, see Figure 1, page 15; Appendix C, pages 48-9; Appendix D, page 50; and Appendix F, 
page 54 in J. DePaoli, J. Bridgeland, and R. Balfanz, Building a Grad Nation: Progress and Challenge in Raising 
High School Graduation Rates (Washington, DC: Civic Enterprises and Everyone Graduates Center at the School of 
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While this is promising, the nation will be unable to continue this trend without doubling down 
on efforts to close gaps among the students who have historically faced the greatest challenges— 
student from low-income families, African American and Hispanic/Latino students, students 
with disabilities, Native students, and English learners. This is critical because, although progress 
has been made, substantial gaps remain. (See Appendix B for information on graduation rate 
gaps in each state.) 


In addition, the nation must improve the low-graduation-rate high schools that disproportionately 
enroll historically underserved students (see Appendix C for the number of low-graduation-rate 
high schools in each state).? As states move forward with ESSA implementation plans, it is 
essential that ED ensures states implement ESSA’s requirement for comprehensive support and 
improvement in high schools that fail to graduate one-third or more of their students. 


ESSA Preserves the Limited but Critical Role of the Federal Government 


When Congress enacted ESSA, it preserved the limited but critical role of the federal 
government in ensuring all children have access to a high-quality education. While | may not 
agree with all of its findings, | appreciate that ED is carrying out its oversight role as required 
under the law in its letters to states responding to proposed ESSA plans. 


There are many organizations working to decipher what is in state plans and provide the public 
with digestible information about them. The Alliance, for example, produced ESSA Equity 
Dashboards that provide a red, yellow, or green determination on thirteen equity-focused 
requirements. I have submitted the ESSA Equity Dashboards that are currently available as part 
of my testimony (See Appendices D-H). They are also available at http://all4ed.org/essa/essa-in- 
your-state/. The remaining dashboards for statues that have submitted their plans will be 
available in August. In addition, Bellwether Education Partners and the Collaborative for Student 
Success led the Check State Plans project (vww.checkstateplans.org), a non-governmental peer 
review process that analyzes state plans and makes information on their strengths and 
weaknesses available to the public in order to improve them. 


| want to be clear that this is not about whether we trust states. I’ve worked with many education 
state leaders and I know they are committed to kids. The fact remains that, while many people 
and organizations outside of government are reviewing and commenting on ESSA plans, only 
ED has the statutory authority and responsibility to review the plans and ensure they comply 
with the law that this committee wrote, 


That said, | believe ED’s comments in several areas are insufficient, have caused confusion, and 
could diminish the quality of ESSA implementation. For example, ESSA allows states to use 

“student access to and completion of advanced coursework” as an indicator of school quality and 
student success [ESSA, Section [11 1(c)(4)(B)(v)(V)]. However, ED criticized a state’s proposal 


Education at John Hopkins University School of Education, 2017), 
hg romise.org/repart/2017-building-grad-nation-report (accessed July 12, 2017). 
° For more information, see Figure 6, page 28 in J. DePaoli et al., Building a Grad Nation. 
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to incorporate performance in Advanced Placement (AP) and International Baccalaureate (B) 
exams in this indicator. 


This is an example of the challenges that arise without clear regulations. ESSA explicitly states 
that access to and completion of advanced course work is permissible, and AP/IB are well- 
recognized examples of advanced coursework, yet a state was criticized for including AP/IB in 
their system. States should be applauded for promoting advanced course work, and | hope ED 
will clarify how these measures can be incorporated into state accountability systems. 


An example of inadequate/confusing oversight within ED’s letters to states Is its review of state 
proposals to ensure compliance with ESSA’s requirement that states identify schools for targeted 
support and improvement if they have a consistently underperforming subgroup of students. This 
is a critical equity-focused policy. In order to help states, districts, and schools implement this 
policy, today the Alliance is releasing a new publication that | submit to the Committee as part of 
my testimony titled School Interventions That Work. Targeted Support for Low-Performing 
Students (See Appendix 1). While | hope this report gives policymakers and practitioners 
assistance as they support low-performing students, only ED can ensure compliance with the 

law. 


One state, for example, states in its ESSA plan that “a school will be identified if it has one or 
more of the lowest performing subgroups in the state over multiple years.” ED’s letter to this 
state appropriately notes that the state must define “multiple years.” However, ED fails to require 
the state to define what level of performance would constitute identification as “one or more of 
the lowest performing subgroups.” 


Several states intend to identify schools for targeted support and improvement if one or more 
subgroups of students demonstrate consistent underperformance in academic achievement-and/or 
high school graduation rates. ED’s response letters note that the statute requires states to consider 
subgroup performance on all indicators in identifying schools. ED needs to clarify that (a) while 
each indicator must be considered, states are not required to use a composite of all indicators in 
identifying schools for targeted support, and (b) there is no statutory requirement for students to 
be consistently underperforming on all indicators to be identified for support. 


If states identify schools for targeted improvement based only on a composite of indicators, they 
are more likely to inadvertently overlook low-performing students because high performance on 
one indicator could mask low performance on another indicator. 


For example, in one state, there are seventy-two high schools where 80 percent or more of the 
African American students graduate on time; but in these same schools, 60 percent or fewer of 
the African American students achieve proficiency in math. This represents 22 percent of all 
high schools in this state. [In another state, there are 135 high schools where 80 percent or more 
of the Latino students graduate within four years, but 60 percent or fewer of the Latino students 
achieve proficiency in reading. If states aggregate the high school graduation rates, math 
proficiency rates, and reading proficiency rates together, the high graduation rate will mask the 
low proficiency rates. As a result, schools with African American and Latino students who are 
struggling in math and reading may not be identified for support. 


41Page 
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Rather than aggregating the performance of student subgroups into a composite, state systems of 
meaningful differentiation should identify schools for targeted support based on the performance 
of any single subgroup on any single indicator. Moreover, states can develop such systems while 
also complying with ESSA’s requirement that states base their system of differentiation on all 
indicators in the system. They can do this by considering the performance of student subgroups 
on all indicators when identifying schools and then allowing failure ona single indicator to 
trigger identification, In other words, amy indicator can trigger identification, but students need 
not fail on all indicators to be identified for support. 


State plans can be hundreds of pages long. The fact that ED has sent letters to states with less 
than twenty pages of comments should come as little surprise. This is the bare minimum required 
for ED to carry out its oversight duty that Congress assigned to it when passing the law, In the 
absence of clear guidance from ED on these critical issues, states are looking to organizations 
like the Alliance for Excellent Education for input and insight on best practices and evidence~ 
based strategies to address the needs of their student population. 


The Quality of ESSA State Plans Is Uneven 


The quality of ESSA state plans is uneven, There are certainly some strengths, but there are 
missed opportunities and many weaknesses, including proposals that violate the law. 


Goals 

While states have set high goals for achievement and high schoo! graduation rates, performance 
against these goals is rarely included in their accountability systems as required under ESSA 
[ESSA See. 111 1(c)(4)(B)]. 


Targeted Support and Improvement for Historically Underserved Students 


ESSA very clearly requires states to identify schools for targeted support and improvement if 
“any subgroup of students is consistently underperforming” [ESSA Sec. LT 1(e}(4)(C) dit]. 
Rather than considering the performance of each subgroup, some states aggregate subgroups 
together, which violates the law and masks the performance of historically underserved students, 
One state, for example, proposed the use of a “super subgroup” that combines the performance 
of black, Hispanic, and Native students. This is unfortunate because these groups of students are 
distinct and they do not have the same level of academic performance. For example, according to 
this same state’s department of education, there is a 20-point difference between the percentage 
of Native American students (54.2 percent) and that of African American students (74.2 percent) 
who were below basic when tested on their Algebra I proficiency. Moreover, there is a 26.8- 
point difference among the same groups in Algebra HI proficiency. By combining these groups of 
students together in violation of the law, this state runs the risk of inadequately supporting 
historically underserved students, 


ESSA also requires states to measure each of their indicators “separately for each subgroup of 
students” [ESSA, Sec. 11 11(c)(4)(B)] for accountability purposes. To my knowledge, no state is 


30 


proposing to do this in their ESSA plan. Many states propose systems that will give schools 
ratings, but these-ratings do not specifically include the performance of student subgroups as 
envisioned under the law, What this means is that schools can receive-an “A,” even though 
African American students, Latino students, or other historically underserved groups are under- 
performing. 


To be very clear, this is not a hypothetical situation. A report from The Education Trust provides 
an example of a state where, in schools that received an “A,” only 58 percent of African 


American students were proficient in reading. 


95 Percent Test Participation Rate 


Additionally, ESSA requires that 95 percent of students participate in statewide assessments so 
that low-performing students are not encouraged to be absent on test day. States are required to 
incorporate this policy into their accountability systems, yet the degree to which this is 
meaningfully happening varies considerably across state plans. One state, for example, explicitly 
states that it intends to defy the law. Specifically, ESSA is very clear about how test participation 
is to be calculated [ESSA, Section [11 1(c)(4)(E){ii)] and this state explicitly states that it will use 
a different calculation. Several other states fail to specify consequences for failing to meet the 95 
percent test participation requirement for all students and each subgroup. For example, one state 
intends only to apply this requirement to the “all students” group and its “super-subgroup.” 
Another state does not address this requirement.and merely states that it will await guidance 
from BD. 


The 95 percent test participation requirement is yet another area where ED‘s oversight has been 
lacking. Not a single letter from ED has mentioned this critical equity-focused policy. 


High School Graduation Rates 


ESSA requires states to include the four-year graduation rate in their accountability systems 
because the ultimate goal of the K-12 education system is for students to graduate from high 
school prepared for postsecondary education and the workforce. There is a long history of 
inaccurate calculations being used to mask low graduation rates, which is why ESSA is explicit 
about the use of the four-year adjusted cohort graduation rate, even going so far as to provide a 
specific definition for the calculation. Nonetheless, several states do not use the four-year 
graduation rate as a stand-alone indicator in their accountability systems as required under the 
law, 


Innovation 


While ESS.A’s flexibility was intended to unleash creativity and innovation, this by and large has 
not happened. We hoped to see policies that promote critical thinking and problem solving, what 


3N. Ushomirsky, D. Willams, and D. Hall, Afeding Sure All Children Matter; Getting School Accountability 
Signals Right (Washington, DC: Education Trust, 2014), https://edtrust.org/resource/making-sure-all-children= 
accountabilitv-signals-right/ (accessed July 14, 2017). 
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some refer to as “deeper learning,” not just memorization and test-taking skills. However, state 

plans thus far would be more accurately characterized as cautious, net courageous. That said, 

there are a few notable exceptions: 

» Louisiana is raising expectations for its students and ensuring that an “A” rating reflects the 
level of performance that one would expect of an “A” school. Louisiana also incorporates a 
“strength of diploma” indicator in its accountability system to incentivize preparation for 
postsecondary education and the workforce. 

s Delaware-and Illinois are examples of states that incorporate the percentage of ninth-grade 
students who are on track for on-time graduation. This is an indicator demonstrated by 
research to accurately predict high school graduation rates and will incentivize early 
intervention to increase graduation rates. 

° Several states (Arizona, Connecticut, Delaware, Illinois, Louisiana, Massachusetts, Michigan, 
New Mexico, Vermont) propose to include measures of college.and career readiness in their 
accountability system (e.g., access to and performance in rigorous course work), 


Proposed Funding Cuts Jeopardize ESSA Implementation 


Money is not magic. However, funding was promised when Congress passed ESSA, Cuts 
proposed by the Trump administration and House Labor-H committee will undermine the law 
before states have the chance to implement it. ESSA provides states with flexibility and 
responsibility. But responsibility without resources will not lead to results, 


By freezing funding for Title I, under-funding Title IV, Part A, and proposing to eliminate or 
reduce funding for professional development, literacy, and after school programs—on top of 
proposed cuts to Medicaid that jeopardize the services schools provide to the nation’s most 
vulnerable children—states are being handcuffed at the exact moment they have supposedly been 
given freedom, 


Conclusion 


It is paramount that we work together to support states in developing their ESSA plans because 
these plans are more than just a bureaucratic exercise in compliance. State ESSA plans outline a 
state’s vision, strategy, and commitment to children, parents, teachers, school leaders, employers, 
and the public writ large regarding how they will ensure all students have access to an education 
that is characterized by equity and excellence. 


Considering that nearly two-thirds of the nation’s jobs will require at least some postsecondary 
education by the year 2020, it is not hyperbole to suggest that ESSA implementation is at the 
heart of the nation’s economic success. We can either step on the gas or put on the brakes, By 
maintaining a commitment to equity, enforcing ESSA’s requirements, and strengthening the 
investment in education, the nation can ensure that every child in America graduates from high 
school prepared for the competitive economy that lies ahead. 


Thank you again for the opportunity to testify. 


“For more information see the University of Chicago’s To & Through Project at https://toandthrough uchicago.eduy. 


>A. Carnevale, N. Smith, and J. Strohl, Recovery: Job Growth and Education Requirements Through 2020 
(Washington, DC: Georgetown University Center on Education and the Workforce, 2013), 


p-content/uploads/20 14/1 1/Recoverv2020.ES Web pdf. 
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Appendix A: Equity-Focused Requirements in the Every Student Succeeds Act 


Long-term goals and measurements of interim progress 
Section 1111(c)(4)(A) requires each State to establish ambitious long-term goals and 
measurements of interim progress toward those goals for academic achievement and high 
school graduation rates for all students and cach subgroup of students, 


Accountability indicators 
Section 1111(c)(4)(B) requires each state to include multiple indicators of student 
performance in its statewide accountability system. These indicators must be annually 
measured for all students and separately for each subgroup of students for each school in 
the state. The required indicators include: student scores on annual assessments; English 
language proficiency; at least one indicator of school quality or student success; for 
elementary and middle schools, a measure of student growth or other academic indicator; 


and for high schools, graduation rates. 


Participation in assessments 
Section 1111(c)(4)(E) requires each State to annually measure the achievement of not 
less than 95 percent of all students and 95 percent of all students in each subgroup of 
students on the statewide assessments in reading/language arts and mathematics. Each 
State must also factor this requirement into its statewide accountability system. 


Subgroups of students 
Section 1111(c)(2) requires the following subgroups of students to be included in a 
statewide accountability system: economically disadvantaged students; students from 
major racial and ethnic. groups; children with disabilities; and English learners. 


Disaggregation of student data (n-size) 
Section 1111(c)(3) requires each State to determine, in consultation with stakeholders, a 
minimum number of students (“n-size”) to be used for accountability and reporting 
purposes. The n-size must be the same for all students and for each subgroup of students, 


Comprehensive support and improvement schools 
Section 11 11(c)(4)(D) requires each State to establish a methodology based on the system 
for annual meaningful differentiation to identify public schools for comprehensive 
support and improvement beginning with the 2017-18 school year, and at least once 
every three years thereafter. Comprehensive support and improvement schools include: 
the lowest-performing five percent of all Title | schools tn the State; any public high 
school in the State failing to graduate one-third or more of its students; and Title [ schools 
with a consistently underperforming student subgroup performing at the level of the 
lowest-performing five percent of Title | schools that has failed to improve after 
implementation of a targeted support and improvement plan, 


Targeted support and improvement schools 
Section LEE M{c)4)(C)dii) and Section 111 1¢d)(2)(A}(G) require each state to use its 
system for annual meaningful differentiation to identify public schools in which any 
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subgroup of students is consistently underperforming, as determined by the state, for 
targeted support and improvement. 


In addition, Section 111 1(d)(2\(C) requires the identification of public schools with a 
subgroup performing at the level of the lowest-performing five percent of Title | schools 
for targeted support and improvement. 


91 Page 


34 


& & < 2° 
§ ES oe é 
= = &? = 
= VS << = 
s o s & 
< &. ge Ss 
STATE s ee es STATE s 
Rate {% Fate (9) Rate (9%) 
Wisconsin 829% 82.7% 


Ohio 

Minnesole 83.2% 

Nevada Z “80.9% 

New York 87.8% 

Nebraska 82.0% 

Pennsylvania BE.8% 

South Dakota BBS 

utah 80.0% 

California Kentticky ag. 35s “Oa 
Michigan New Hampshire S845 80.0% 
Missourt Texas BAR BERN 
Connecticut Maing 87.9% 0.0% 
Florida 69.0% Georgia 3 Be 8% 75:25 
itiinois § 75.8% Vermont 88.9% 81.0% 
Indiana 89,6% 49% Mississiani ISAO TRON 
North Dakola. © SO TSO Oklahoma 84.2% T7.A% 
Massachusetts 91.8% 77.5% Montana : 786 “2.0% 
Wyoming BOI 88.0% oe North Carolina 88.3%, 82:294 
owa 92.4% 73.0% South Carolina SBR 7878, 
Oregan F608 8 88.0% idaho 80.85% 75.0% 
Coloratia 82.6% 89.9% Hawai 0% Pam 
New Mexico FBO 81.0% Delaware 88.0% 83.2% 
New Jersey 94.0% 81.5% West Virginia BET BRR 
Washington “809% e8% RT Alabama 30.5% 87.0% 35 


“in December 2016, following an internat audit and US Department of Education investigation, Alabama edication officials announced that graduation 
rates in the state had been Improperly oslculated and that the reported rates were inaccurate. We include the reported rates here, but nete this Important 
caveat anc’ warn that thase rates, in many cases, may be inflated, 

Note, These tables are sorted by the Percentage Point Gap Differences between groups for the 2014-18 State Level ACGR. 

Sourca: U.S. Department of Education (2018). Provisional Date Filo: SY2074-15 Four-Year Regulatory Adjusted Cohort Graduation Rates (ACGR); 
Guileing A Grad Nation, 2017. Pages 51-32 . 


& 
= gS ge 

STATE S ¥ LS 
a Rate (95) Rate (9%) 

New York 8.8 Fi2% 3.8 

Minnesota . 

Pennsylvania 

South Dakota 

Massachusntts 

Connecticut. 

“Ohio 

North Dakota 

‘Wisconsin Louisiana 

Maryland vr: Tennessee 

Colorado: : Delaware 

New Hampshire 88.9% 13.9 . Texas 

Vieginia ~ Ingisria 

Utah 13.0 Missouri 

Michigan : : a New Mexico 

Vississippt 794% BB.0% Kentucky 

Nevada 78.05, 68.7% Florida 

Washington 80.9% 69.8% Montana 

Now Jersey ee South Caratina 

Nebriska 92.5% 81.8% Oklahoma, 

Georgia oo SE ABRIBSE CE 78086 Hawaii 

fibade Island BE.8% 76.0% Arkansas 

Arizona ccd ee a Alabama* 

Kansas 88.3% 78.2% Vermont 

Wyomitij BNR 720% West Virginia 


‘tn December 2016, following an internal audit and US Department of Education investigation, Alabama education officials announced that graduation 
sates in the state had been improperly calculated! and that ihe reported rates were inaccurate. We include the reported rates here, but note this important 
caveat anc want that these retes, in many cases, may be inflated. 

Nota, These tables are sorted by the Percentage Point Gap Differences between groups for the 2014-18 State Level ACGA, 

Source: U.S, Qeapartment of Education (¢ al Data Fite: SY2014-15 Four-Year Regulatory Adjusted Cohort Graduation Rates (ACGR). 
Building A Grad Natian, 2017, Pages 51-83 


x & x 
STATE CS stare os cS ee 
‘ fate (%} Rate (%} _ 
Naw York abe Florida 8% 78. 1S 
fizona $40 tat BROS 198 
Nevada 429° verinant s9.0% 194 
Vieginia 429 Colorado ee aBg 
Maryland . aay ? Delaware BO. FS 
Hawait > 373 Missouri TRO 
Nebraska 35.1 Texas 16g 
Ohia Bi New Jersey 163 
South Dakota: 235 California 164 
North Carolia 283 Wyoming tay 
Louisiana 278. ; Alabama* 1a 
Wisconsin 27.0 iinois 4 
North Dakota 25.2. 07 Tennessee 13.2 
Magsachusetts 25.0 Indiana 1a 
Maniana 52.0% 24.3 New Hampshire Ma 
Oregon 510% 24.0 Maine TO? 
Washingtod B5,8% 23.7 Kansas aS 
Georgia S649 23.2 fowa Bt 
Oklahoma BOON: 23.0 Michigan $0 
Pennsylvania 82.0%. 22.7 Idaho VS 
Migsissippt 53.0% : Le 228 Rhode island 7:0 
Connecticut 67.0% 213 New texico 10 ace 
Kentucky SO BPO 212 South Carolina 78.0% 4a 
Alaska 86.0% 21.0 West Virginia & 86.095. 0.5: 
Minnosata 83.1% 204 Arkansas 88.0% 84.8% 412 


ficials announced that graduation 
fates here, but note this important 


@ Point Gap Differences between groups for the 2014-15 State Level ACGA. 
. Provisional Data File: S¥2014-15 Four-Year Regulatory Adi 


fect Cohort Graduation Rates (ACGR), 
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Appendix C. ESSA High Schools (100 or more students) with ACGR of 67 Percent or 
Below by State, 2014-15 


Alabama ae ae 
Alaska re) 
Arizona Rees 
Arkansas 10 
Califomia =~ = asi 
Colorado 32 
Connecticut SES EQes 
Delaware ee 
District OF SS 
Columbia eee : 
Florida peg 
Georgia 258 
Hawail g 
Idaho SEES 
Minois a8 
Indiana : 33. 
fowa 1 
Kansas Sees 
Kentucky 43 
Maine renee 
Maryland 32 
Massachusetts 35): 
Michigan AVE 
Minnesota 60. 
Mississippi 2 
Missouri 16 
Montana 6 
Nebraska 3 
Nevada Eye 
New 3 
Hampshire 

New Jersey 8 3 
New Mexico 72 
New York 265 
North Carolina 14 
North Dakota 7 
Ohio bss) 
Oklahoma 2 
Oregon $1 
Pennsylvania 52 
Rhode Island AE 
South Carolina “46 
South Dakota. = 8 
Tennessee 25. 
Texas BRS 
Utah 38 
Vermont E ce 
Virginia “yo 
Washington csc ae 
West Virginia a 
Wisconsin SSS 
Wyoming 3 
Total 2249 


Fortiore information, seé Appendix L, page 62 ja J. DePaoli, J. Bridgeland, and R. Balfanz, Building d Grad Nation: Progress dit 
Challenge in Raising High School Grealwation Rates, (Washington, DC: Civic Enterprises and Everyone Graduates Center at the School 
af Education at Jolin Hapki miversity School of Education, 2017), hitys://eradnation. americaspromise. orgteport/201 7-building-arad- 
nation-report (aceessed July 12, 2017). 
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AN ANALYSIS OF COLORADO'S ESSA PLAN 


hboard analyzes Colorade’s plan under the Every Student Succeeds Act (ESSA), 
ifcally its commitment to equity and excellence and its compliance with the law, This 
is not all-encompassing but rather focuses on the indicators most essential for 
advancing equitable educational opportunities for all students. Colorado submitted its plan 
on May 9, 2017; full text is avail able at https://ed 
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Academic Achievement 


No Clear goals for pro 
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4-Year Cohort High School Graduation Rate | Schools for Comprehensive Support 
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Extended-Yeay.re Cohort stat School Graduation Rate 
ar cohort graduation rates 
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ss 


English Language Proficiency 
‘Has netsst Maxinvum timelines but plans to set ones 
Mer that aceount for students’ initial proficiency level 


ACCOUNTABILITY 


Disaggregation of Student Subgroups 


--Disagpregates subgroups by race; ethr 
Gren. statis; combinas students from non-w 


N-Size 


16 students for achievement and high school graduation rate; 20 students for academic growth 


yy income, English language proficiency, and di 
hite racial groups that do not meet minimum v-size 


Yaiiows 
School Quality and Student Success (SQSS} Indicator 


© Dropout rate for high school; chronic abseriteeism for elementary and middle schools 


Grae 


| CONCERN 


High School Graduation Rate 


Uses 4-year arid extended-year cohort graduation rates but weights assigned toéach are unclear 


vation 


Weighting of Academic Indicators 
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Note: Some indicators do not apply te some states and, consequently, do not appear in the analysis included on the front of this 
document. The Alliance for Excellent Education set the parameters associated with the green, yellow, and red designations. 


Academic Achievement 


@® Green: 75% or move of all students proficient on statewide 
assessments by 2630 or equivalently rigorous goal 

Yellow: 60-74.9% of all students proficient by 2030 or 75% ar 
mare proficient by 2031-39 or equivalently rigorous goal 


& Red: Less rigorous goals and/or longer timeline than 2040. 


Academic Achievement by Student Subgroup 
& Greev: Same long-term goals for each subgroup orsimilarly 
ambitions commitment to closing achievement gaps 


Yellow: Less ambitious goals but requires higher rates of growth 
from lower-performing subgroups 
® Red: Same or similar rates of academic growth for all subgroups 


4-Year Cohort High School Graduation Rate 
® Green: 90% or more of students graduating by 2030 
Yellow: 85-89.9% of students graduating by 2030 or 90% ar more 
graduating by 2031-39 
Wy Red t 


ss rigorous goals and/ar Jonger timeline than 2040 


Extended-Year Cohort High School Graduation Rate 
® Green: At least 3 percentage points higher than 4-year cohort rate 
goal 
% Yellow: 1-2 percentage points higher than 4-year cohort rate goal 


® Red: Goals are the same or state does not set goals for each cohort 
vate 


English Language Proficiency 


® Green: Accounts for initial age/grade or proficiency level in setting 
student targets with maximum timeline of no more than 6 years to 
achieve proficiency 


4) Yellow: Accounts for initial age/grade or proficiency level with 
maximum timeline af 7 years to achieve proficiency 

® Red; Does not account for initial age/grade or proficiency level 
and/or sets maximum timeline of 8 or more years to achieve 
proficiency 


Disaggregation of Student Subgroups 
@ Green: State does not use super-subgroup or uses it only in 
addition to disaggregated subgroups for school ratings and/or 
identifying schools for support 
w Red: State uses super-subgroups instead of required subgroups for 


school ratings and/ur identifying schools for support 
N-Size 


® Green: N-size for accountability of 15 or fewer students 


@ Yellow: N-size for accountability of 16-25 students 


®@ Red: N- 


ze for accountability of 28 or more students 


iance for Excellent Education, June 2017. 


School Quality and Student Success (SQSS) Indicator 

@ Green: Evidence-based statewide SQSS measures ard disdggregated 
by student subgroup 
Yellow: Inconclusive evidence for SQSS measures or significant 
measures are in development but still statewide and disaggregated 
by student subgroup 
Red: No evidence for SQSS measures and/or not statewide or 
disaggregated by student subgroup 


a 


@ 


High Scheol Graduation Rate 

@ Green: Exclusively uses or gives more weight to 4-year cohort 
graduation rate 
Yellow: Uses 4- and extended-year cohort vates and weights 4-year 
rate equally or less than other rates 


‘a 


® Red: Does not use 4-year cohort rate or uses another unlawful 
graduation rate calculation 


Weighting of Academic Indicators 
@ Green: 75% or more weight on academic indicators 
& Yellow: 50-74% weight on academic indicators 


® Red: Less than 50% weight on academic indicators or weight is 
unclear in plan 


Testing Participation Rates 


® Green: No credit for untested students ot similarly rigorous 
consequences 


» Yellow: Less rigorous consequences that have limited implications 
for accountability 


® Red: Does not specify consequences for untested students 


Inclusion of Subgroup Performance 
® Green: Schools receive lawer rating if they have a struggling 
subgroup or subgroup performance is an independent and 
substantial portion of rating index 


Yellow: Subgroups have lesser but still meaningful effect on'a 
school’s rating, 


® Red: Subgroups have little to no effect ona school’s rating 


(SUPPORT AND INTERVENTION 


Definition of “Consistently Underperforming” Used to Identify 
Schools for Targeted Support 
® Green: Definition is meaningfully different from “low performing” 
and triggers targeted intervention based on 2 or fewer indicators 
& Yellow: Definition is meaningfully different from “low performing” 
and triggers targeted intervention based on 3 or more indicators 
® Red; Definition is nor meaningfully different fram statutory 
definition of “low performing” or does not comply with ESSA 


High School Graduation Rate Used te Identify Schools for 
Comprehensive Support 


® Green: 4-year cohort graduation rate 


Yellow: 5-year cohort graduation rate 
@ Red: 6- 


year (or longer) cohort graduation rate. 


wwiW.allded.org/essa 
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AN ANALYSIS OF DC'S ESSA PLAN 


n under the Every Student 
and excellence and its compliance 


on May 2, 203 
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iecaa2OLZndt. View 
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spot meaningfully 


High School Graduation Rate Used to Identify 
Schools for Comprehensive Support. 
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of student learning in pre-K cla 
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Note: Some indicators do not apply to some states and, consequently, do net appear in the analysis included on the front of this 
document. The Alliance for Excellent Education set the parameters associated with the green, yellow, and red designations. 


Academic Achievement 
o 


Green: 75% or more of all students pioficient on Statewide 
assessments by. 2030 or equivalently rigorous goal 
Yellow: 60-74,9% of all students proficient by 2030 or 75% or 
more proficient by 2031-39 or equivalently rigorous goal 
® Red: Less rigorous goals and/ar longer timeline than 2040 
Academic Achievement by Student Subgroup 

@ Green: Same long-term goals for each subgroup or similarly 
ambitious commitment to closing achievement gaps 
Yellow: Less ambitious goals but requires higher rates of growth. 
from lower-performing subgroups 


® Red: Same or similar rates of academic growth for all subgroups 


4-Year Cohort High School Graduation Rate 
@ Green: 90% or more of students graduating by 2030 


Yellow: 85--89,9% of students graduating by 2030 or 90% or more 
graduating by 2031-39 


® Red: Less rigorous goals and/or longer timeline than 2040 


Extended-Year Cohort High School Graduation Rate 

Green: At least 3 percentage points higher than 4-year cohort rate 
goal 

Yellow: 1-2 percentage points higher than 4-year cohort rate goal 
Red: Goals are the same or state does not set goals for each cohort 
rate 


a 


English Language Proficiency 

® Green: Accounts for initial age/grade or proficiency level in setting 
student targets with maximum timeline of no more than 6 years to 
achieve proficiency 
Yellow: Accounts for initial age/grade or proficiency level with 
maximum timeline of 7 years to achieve proficiency 
Red: Does not account for initial age/grade or proficiency level 
and/or sets maximum timeline of 8 or more years to achieve 
proficiency 


ACCOUNTABILITY. 


Disaggregation of Student Subgroups 
@ Green; State does not use super-subgroup or uses it only in 
addition to disaggregated subgroups for school ratings and/or 
identifying schools for support 


@® Red: State uses super-subgroups instead of required subgroups for 
school ratings and/or identifying schools for support 


N-Size 

® Green: N-size for. accountability of 15 or fewer students 
Yellow: N- 
® Red: N-size for accountability of 26 or more students 


ae for accountability of 16-25 students 


YY 


ALLIANEE FoR, 
EXCELLENT EDUCATION 


© Alliance for Excellent Education, June 2017. 


School Quality and Student Success (SQSS) Indicator 


® Green: Evidence-based statewide SQSS measures are disaggregated 
by student subgroup 

& Yellow: Inconclusive evidence for SQSS measures or significant 
measures are in development but still statewide and disaggregated 
by student subgroup 

®@ Red: No evidence for SQSS measures and/or not statewide or 
disaggregated by student subgroup 


High School Graduation Rate 


@ Green: Exclusively uses or gives more weight to 4-year cohort 


graduation rate 
s§ Yellow: Uses 4- and extended-year cohort rates and weights 4-year 
rate equally or less than other rates . 
Red: Does not use 4-year cohort rate or uses another unlawful 
graduation rate calewlation 


Se 


Weighting of Academic Indicators 


® Green: 75% or more weight on academic indicators — 
®& Yellow: 50-74% weight on academic indicators 


®> Red: Less than 50% weight on acaderhic indicators or weight is 
unclear in plan 


Testing Participation Rates 


@ Green: No credit for untested students or similarly rigorous. 
consequences 


Yellow: Less rigorous consequences that have limited implications 
for accountability 


® Red: Does not specify consequences for untested students 


Inclusion of Subgroup Performance 


@ Green: Schools receive lower rating if they have a struggling 
subgroup or subgroup performance is an independent and 
substantial portion of rating index 

@ Yellow: Subgroups have lesser but still meaningful effect oni a 
school's rating 

® Red: Subgroups have little to no effect on a school’s rating 


SUPPORT AND INTERVENTION. 


Definition of “Consistently Underperforming” Used to Identify 
Schools fox Targeted Support 


® Green: Definition is meaningfully different from “low performing” 
and triggers targeted intervention based on 2 or fewer indicators 

& Yellow: Definition is meaningfully different from “low performing” 
and triggers targeted intervention based-on 3 or more indicators 

® Red: Definition is not meaningfully different from statutory 
definition of “low performing” or does nat comply with ESSA 


High School Graduation Rate Used to Identify Schools for 
Comprehensive Support 


@ Green: 4-year cohort graduation rate 
* Yellow: 5-year cohort graduation rate 
® Red: G-year (or longer) cohort graduation rate 


www,alléed org/essa 
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AN ANALYSIS OF ILLINOIS’S ESSA PLAN 


‘This dashboard analyzes [llinois’s plan under the Every Student Succeeds Act (ESSA), 

spe i itment to equity and excellence and its compliance with the law. This 
l-encompassing but rather focuses on the indicators most essential for 

advancing equitable educational opportunities for all students. [linois submitted Its plan 

on May 2, 2017; full text is available at https://ed gow/admins/lead/account/stateplan]7/ 

Ucsa2QL7.pdf View ESSA equity dashboards for other states at www.allded org/essa. 
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Note: Some indicators do not apply 
document. The Alliance for Excellent 


Academic Achievement 


® Green: 75% ar more of all students proficient an statewide 
assessments by 2030 or equivalently rigorous goal 

Yellow: 60-74.9% of all students proficient by 2030 or 75% or 
mare proficient by 2031-39 or equivalently rigorous goal 


® Red: Less rigorous goals and/or longer timeline than 2040 


Academic Achievement by Student Subgroup 


@ Green: Same long-term goals for each subgroup or similarly 
ambitious commitment to closing achievement gaps 


Yellow: Less ambitious goals but requires higher rates of growth 
from lower-performing subgroups 
© Red: Same or similar rates of academic growth for all subgroups 


4-Year Cohort High School Graduation Rate 
® Green: 90% or more of students graduating by 2030 


® Yellow: 85-89.9% of students graduating by 2030 or 90% or more 
graduating by 2031-39 
® Red; Less rigorous goals and/or longer timeline than 2040 


Extended-Yeax Cohort High School Graduation Rate 


® Green: At least 3 percentage points higher than 4-year cohort rate 
goal 


® Yellow: 1-2 percentage points higher than 4-year cohort rate goal 
@ Red: Goals are the same or state does nat set goals for each cohort 
vate 


English Language Proficiency 


© Green: Accounts for initial age/grade or proficiency level in setting 
student targets with maximum timeline of ne more than 6 years to 


achieve proficiency 
® Yellow: Accounts for initial age/grade or proficiency level with 
maximum timeline of 7 years to achieve proficiency 


& Red: Does not account for initial age/grade or proficiency level 
and/or sets maximum timeline of 8 oy more years to achieve 
proficiency 


ACCOUNTABILIT 


Disaggregation of Student Subgroups 
@ Green: State does not use super-subgroup or uses it only in 
addition to disaggregated subgroups for school ratings and/or 
identifying schools for support 


®@ Red: State uses super-subgroups instead of required subgroups for 


school ratings and/or identifying schools for support 


N-Size 
® Green: N-size for accountability of 15 or fewer students 
8 Yellow: N-size for accountability of 16-25 students 
® Red: N-size for accountability of 26 or more students 


CE FOR 
AT eptcarion: 


© Alliance for Excellent Education, June 2017. 


» some states and, consequently, do not appear in the analysis included on the front of this 
Education set the parameters associated with the green, yellow, and red designations. 


School Quality and Student Success (§QSS) Indicator 

® Green: Evidence-based statewide SQSS measures are disaggregated 
by student subgroup 

2 Yellow: Inconclusive evidence for SQSS measures or significant 
theasures are in development but still statewide and disagpregated 
by student subgroup 

@ Red: No evidence for SQSS measures and/or not statewide or 
disaggregated by student subgroup 


High School Graduation Rate 
® Green: Exclusively uses or gives more weight to 4-year cohort 
graduation rate 
® Yellow: Uses 4- and extended-year cohort rates and weights 4-year 
rate equally or less than other rates 


® Red: Does not use 4-year cohort rate or uses another unlawful 
graduation rate calculation 


Weighting of Academic Indicators 
® Green: 75% or more weight on academic indicators 
S Yellow: 50-74% weight on academic indicators 
® Red: Less than $0% weight on academic indicators ot weight is 
unclear in plan 


Testing Participation Rates 


® Green: No credit for untested students or similarly rigorous 
consequences 

® Yellow; Less rigorous consequences that have limited implications 
for accountability 

® Red: Does not specify consequences for untested students 


Inclusion of Subgroup Performance 

® Green: Schools receive lower rating if they have a struggling 
subgroup or subgroup performance is at independent and 
substantial portion of rating index 
Yellow: Subgroups have lesser but still meaningful effect ona, 
school’s rating 
® Red: Subgroups have little to no effect on a school's rating 


SUPPORT AND INTERVENTION 


Definition of “Consistently Underperforming” Used to Identify 
Schools for Targeted Support 
® Green: Definition is meaningfully different from “low performing” 
and triggers targeted intervention based.on 2 or fewer indicators 
® Yellow: Definition is meaningfully different from “low performing” 
and triggers targeted intervention based on 3 or more indicators 
® Red: Definition is not meaningfully different from statutory 
definition of “low performing” or does not comply with ESSA 


High School Graduation Rate Used to Identify Schools for 


Comprehensive Support 


® Green: 4-year cohort graduation rate 
& Yellow: S-year cohort graduation rate 
®@ Red: 6-year (or longer) cohort graduation rate 


www.all4ed.org/essa 
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AN ANALYSIS OF LOUISIANA’S ESSA PLAN 


shboard analyzes Louisiana's plan under the Every Student Succeeds Act (ESSA), 

ally its commitment to equity and excellence and its compliance with the law. This 
analysis is not all-encompassing but rather focuses on the indicators most essential for 
advancing equitable educational opportunities for all students. Louisiana submitted its plan 
on May 3, 2017; full text is available at bttps://ed.gov/admins; ccount/stateplant 7, 
lacsa2OL7.. Yew ESSA equity dashboards for other states at www.allded org/essa. 
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Note: Some indicators do not apply to some states and, consequently, do not appear in the analysis included on the front of this 


document. The 


Academic Achievement 


® Green: 75% ar more of all students proficient on statewide 
assessments by 2030 or equivalently rigorous goal 

® Yellow: 60-74,9% of all students proficient by 2030 or 75% or 
more proficient by 2031~39 or equivalently rigorous goal 

© Red: Less rigorous goals and/or longer timeline than 2040 


Academic Achievement by Student Subgroup 
® Green: Same long-term goals for each subgroup or similarly 
ambitious cominitment to closing achievement gaps 


Yellow: Less ambitious goals but requires higher rates of growth 
from lower-performing subgroups 
@& Red: Same or similar rates of academic growth for all subgroups 


4-Year Cohort High School Graduation Rate 
® Green: 90% or more of students graduating by 2030 


®. Yellow: 85-89.9% of students graduating by 2030 or 90% or more 
graduating by 2031-39 
® Red: Less rigorous goals and/or longer timeline than 2040 


Extended-Year Cohort High School Graduation Rate 


® Green: At least 3 percentage points higher than 4-year cohort rate 
goal 


#9 Yellow: 1-2 percentage points higher than 4-year cohort rate goal 
wt Red: Goals are the same or state does not set goals for each cohort 
rate 


English Language Proficiency 
® Green: Accounts for initial age/grade or proficiency level in setting 
student targets with maximum timeline of no more than 6 years to 
achieve proficiency 
48 Yellow: Accounts for initial age/grade oy proficiency level with 
maximum timeline of 7 years to achieve proficiency 


® Red: Does not account for initial age/grade or proficiency level 
and/or sets maximum timeline of 8 or more years to achieve 
proficiency 


ACCOUNTABILITY, 


Disaggregation of Student Subgroups 
a Green: State dogs not use super-subgroup or uses it only in 
addition to disaggregated subgroups for school ratings and/or 
identifying schools for support 
® Red: State uses super-subgroups instead of required subgroups for 
school ratings and/or identifying schools for support 


N-Size 
@ Green: N-size for accountability of 15 or fewer students 
® Yellow: N-size for accountability of 16-25 students 
® Red: N-size for accountability of 26 or more students 


ALMANCE FON 
» EXCELLENT EQUCATION 


© Alliance for Excellent Education, June 2017. 


ance for Excellent Education set the parameters associated with the green, yellow, and red designations. 


School Quality and Student Success (SQSS) Hidicator 
® Green: Evidence-hased statewide SQSS. measures are disaggregated 
by student subgroup 
@ Yellow: Incenclusive evidence for SQSS measures or significant 
measutes are in development but still statewide and disaggregated 
by student subgroup 


® Red: No evidence for SQSS measures and/or not statewide or 
disaggregated by student subgroup 


High School Graduation Rate 
® Green: Exclusively uses or gives more weight to 4-year cohort, 
graduation rate 
& Yellow: Uses 4- and extended-year cohort rates and weights 4-year 
rate equally or less than other rates 


® Red: Does not use 4-year cohort rate or uses another unlawful 
graduation rate calculation 


Weighting of Academic Indicators 
® Green: 75% or more weight on academic indicators 
& Yellow: 50-74% weight on academic indicators 
® Red: Less than 50% weight on academic indicators or weight is 
unclear in plan 


Testing Participation Rates 
® Green: No credit for untested students or similarly rigorous 
consequences 


® Yellow: Less rigorous consequences that have limited implications 
for accountability 


® Red: Does not specify consequences for untested students 


Inclusion of Subgroup Performance 


@ Green: Schools receive lower rating if they have a struggling 
subgroup or subgroup performance is an independent and. 
substantial portion of rating index 


& Yellow: Subgroups have lesser but still meaningful effect’on a 
school’s rating 


@ Red: Subgroups have little to no effect on a school’s rating 


SUPPORT AND INTERVENTION. 


Definition of “Consistently Underperforming” Used to Identify 
Schools for Targeted Support 
® Green: Definition is meaningfully different from “low performing” 
and triggers targeted intervention based on 2 or fewer indicators 


Yellow: Definition is meaningfully different from “low performing” 
and triggers targeted intervention based on 3 or move indicators 
® Red: Definition is not meaningfully different from statutory 
definition of “low performing” or does not comply with ESSA 


High School Graduation Rate Used to Identify Schools for 
Comprehensive Support 


® Green: 4-year cohort graduation rate 
© Yellow: S-year cohort graduation rate 
® Red: 6-year (or longer) col 


graduation rate 


waww.al dedora/essa 
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AN ANALYSIS OF NEW MEXICO’S ESSA PLAN 


Yew Mexico's plan under the Every Student Succeeds Act (ESSA), 

nt to equity and excellence and its compliance with the law. This 

sing but rather focuses on the indicators most essential for 
advancing equitable educational opportunities for all students. New Mexico submitted its plan 
on April 11, 2017; full text is available at https://ed gov/admins/i Bt land, 
pmesa20lZpdf View 


SUPPORT AND INTERVENTION 


~ Definition of ~Consistently Underperforming” Used 
toldentify Schools for Targeted Support 
@ -Wdentifies schotls based on achievement gaps in: 
Geen Teading and ihath between ore or inore student 
subgroups and students outside that subgroup 


High School Graduation Rate Used to Identify 
Schools for Comprehensive Support... : 
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‘Disaggregation of Student Subgroups 
Disagategates subgroups by race, ethnicity, income, English language proficiency, and 
ceean’ disability status 


NeSize. 


No minimum for growth and proficiency. 


rien. 


School Quality and Student Success (SQSS) Indicator 
iy. Chronic absenteeism, college and career readiness (to include college remediation and persistence 
vatow rates), abd “Opportunity-to-Learn Survey”; latter two are in development 
High School Graduation Rate 
— 


gram. wed 


tiple the Weight to d+year cohort rate. comparéd to S-yéar cohort rate, and six times the 
ht to dyear cohort rate compared to 6-year cohort rate 


Weighting of Academic Indicators 


90% weight in all grades 


cream 


Testing Participation Rates 
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Note: Some indicators do not apply to some states and, consequently, do not appear in the analysis included on the front of this 
document. The Alliance for Excellent Education set the parameters associated with the green, yellow, and red designations. 


School Quality and Student Success (SQSS) Indicator 


@ Green: 75% or more of all students proficient on statewide ® Green: Evidence-based statewide SQSS measures are disaggregated 
assessments by 2030 or equivalently rigorous goal by student subgroup 
& Yellow: 60~74.9% of all students proficient by 2030 or 75% or @ Yellow: Inconclusive evidence for SQSS measures or significant 
more proficient by 2031-39 or equivalently rigorous goal measuves are in development but still statewide and disaggregated 
® Red: Less rigorous goals and/or longer timeline than 2040. by student subgroup 
® Red: No evidence for SQSS measures and/or not statewide or 
Academic Achievement by Student Subgroup disaggregated by student subgroup 
® Green: Same long-term goals for each subgroup or similarly 
ambitious commitment to closing achievement gaps High School Graduation Rate 
® Yellow: Less arnbitious goals but requires higher rates of growth @ Green: Exclusively uses or gives more weight to 4-year cohort 
from lower-performing subgroups graduation rate 
® Red: Same or similar rates of academic growth for all subgroups ® Yellow: Uses 4- and extended-year cohort rates and weights 4-year 
rate equally or less than other rates 
4-Year Cohort High School Graduation Rate @ Red: Does not use 4-year cohort rate or uses another unlawful 


@ Green: 90% or more of students graduating by 2030 graduation rate calculation 


Yellow; 85~89.9% of students graduating by 2030 or 90% or more 
graduating by 2031-39 
® Red; Less rigorous goals and/or longer timeline than 2040 


Weighting of Academic Indicators 
@ Green: 75% or more weight on academic indicators 
% Yellow: 50-74% weight on academic indicators 
Extended-Year Cohort High School Graduation Rate ® Red: Less than $0% weight on academic indicators or weight is 
® Green: Atleast 3 percentage points higher than 4-year cohort rate unclear in plan 
goal 
# Yellow; 1-2 percentage points higher than 4-year cohort rate goal 
@ Red; Goals are the same or state does nat set goals for each cohort 
rate 


Testing Participation Rates 
® Green: No credit for untested students or similarly vigorous 
consequences : 
® Yellow: Less rigorous consequences that have limited implications 


English Language Proficiency for accountability 


® Green: Accounts for initial age/grade or proficiency level in setting 
student targets with maximum timeline of no more than 6 years to 


® Red: Does not specify consequences for untested students 


achieve proficiency Inclusion of Subgroup Performance : 
vt Yellow: Accounts for initial age/grade or proficiency level with ® Green: Schools receive lower rating if they have a struggling 
maximum timeline of ? years to achieve proficiency subgroup or subgroup performance is an independent and 


4 Red: Does not account for initial age/grade or proficiency level substantial portion of rating index 
and/or sets maxirnum timeline of 8 or more years to achieve Yellow: Subgroups have lesser but still meaningful effect ona 
proficiency school’s rating 
© Red: Subgroups have little to no effect ona school’s rating. 


ACCOUNTABILITY. . wet 
SUPPORT AND INTERVENTION 


Disaggregation of Student Subgroups 


Green; State does not use super-subgroup or uses it only it: Definition of “Consistently Underperforming” Used to Identify 
addition to disaggregated subgroups for school ratings and/or Schools for Targeted Support 
identifying schools for support ® Green: Definition is meaningfully different front “low performing” 

w® Red: State uses super-subgroups instead of required subgroups for and triggers targeted intervention based on 2 or fewer indicators 
school ratings and/or identifying schools for suppert © Yellow: Definition is meaningfully different from “low performing” 

and triggers targeted intervention based on 3 or more indicators 
N-Size ® Red: Definition is not meaningfully different from statutory 
® Green: N-size for accountability of 15 or fewer students definition of “low performing” or does not comply with ESSA 


® Yellow: N-size for accountability of 16-25 students 


High School Graduation Rate Used to Identify Schools for 
Comprehensive Support 


® Green: 4-year cohart graduation rate 
Yellow: 5-year cohort graduation rate 


® Red: N-size for accountability of 26 or more students 


® Red: 6-year (or longer) cohort graduation rate 


LAG 


» ARUN Bibeanan © Alliance for Excellent Education, June 2017. www.all4ed.org/essa 
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Chairwoman Foxx. Thank you, Mr. Lovell. 
Dr. Wright, you are recognized for 5 minutes. 


TESTIMONY OF CAREY WRIGHT, STATE SUPERINTENDENT, 
MISSISSIPPI DEPARTMENT OF EDUCATION 


Ms. WRIGHT. Thank you. Before I want to start I wanted to intro- 
duce people that are key to the implementation of this back in my 
State. I have my State board chair, Ms. Rosemary Aultman, with 
me; the vice chair, Dr. Jason Dean; and one of my chiefs who is 
responsible for legislation and communication who are here with 
me today. So thank you. 

Chairman Foxx, Ranking Member Scott, and members of the 
committee, thank you for the opportunity to testify about Mis- 
sissippi’s work to implement the Every Student Succeeds Act or 
ESSA. I look forward to sharing my perspective as the state super- 
intendent of education for Mississippi, and I am also president- 
elect of the board of directors for the Council of Chief State School 
Officers. 

ESSA has given Mississippi the opportunity to create a plan spe- 
cifically designed for the students of our State. At the same time, 
the law provides guardrails to ensure our work is appropriately 
targeted toward improving educational opportunities and outcomes 
for all students and all schools. 

Our plan is called Mississippi Succeeds and we are proud that 
it builds upon our State board’s strong strategic plan to prepare 
students for college and careers. This strong foundation includes a 
rigorous academic standards for all students, aligned assessments 
to track student achievement, and an accountability model that 
clearly measures the performance of our schools and our districts. 

Our ESSA plan also builds upon the significant investments that 
Mississippi has made in early childhood education, literacy, career 
and technical education, advanced coursework opportunities for 
students, and professional development for all teachers. All of these 
initiatives have broad stakeholder support and have resulted in im- 
proved student outcomes. 

To design Mississippi Succeeds we again sought raw input from 
stakeholders over an 18-month period to craft a plan tailored to the 
needs of our students. During those 18 months, we conducted a lis- 
tening tour which included 15 public meetings throughout the 
State. We hosted targeted meetings with specific stakeholder 
groups, and collected feedback through an online survey. 

ong our most active participants were advocates for the un- 
derserved, majority African-American communities in rural, low-in- 
come areas of the State, parents of students with disabilities, and 
teachers of English language learners. Mississippi has a small but 
growing population of English learners and most of the teachers of 
the English learners who participated in our feedback sessions 
were the only people in their schools whose work was dedicated to 
English learners. 

Throughout these meetings and the online survey, we gathered 
7,300 feedback points. We established working groups, and we es- 
tablished an ESSA advisory committee made up of stakeholders to 
provide us feedback and input throughout the entire development 
of our plan. 
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We intend to keep all of our partners engaged in our implemen- 
tation of the plan through regular meetings with our stakeholders 
as well as with the ESSA advisory committee. The robust participa- 
tion of stakeholders helped Mississippi develop a strong plan to 
meet the requirements of ESSA. And I am especially excited about 
the following aspects of our plan; providing effective teachers with 
the opportunities to not only teach children, but to work collabo- 
ratively to lead colleagues to improve their practice, expanding 
early childhood to support early childhood educators in a variety of 
pre-K settings to implement developmentally appropriate practices 
in their classrooms, improving schools by investing in the local 
teachers and administrators, supporting communities through P16 
councils, strengthening parent engagement through school-based 
activities. 

We appreciate the flexibility of ESSA because we intend to in- 
clude subgroup performance to identify schools for school improve- 
ment support. This will have the greatest impact on African Amer- 
ican students who make up our State’s largest underperforming 
subgroup. We are expanding career and technical education to pro- 
vide continuous computer science education in grades K through 12 
and to provide our high school students with the opportunity to 
graduate with a career and technical diploma endorsement that is 
of equal value to an academic endorsement. 

We are putting a strong focus on eliminating the proficiency gap 
between African Americans and all students entirely so that the 
proficiency rates for all of our subgroups will increase to 70 percent 
by 2025. All of these initiatives are dependent on Federal support 
for public education. As a State chief, I understand that Federal re- 
sources are limited and that States must be effective stewards of 
tax dollars. 

Mississippi’s ESSA plan is built around the targeted and efficient 
use of Federal funds to maximize the impact on student achieve- 
ment, especially of our most disadvantaged students. I want to 
thank you for the flexibility that you have provided through the 
Every Student Succeeds Act, and as you can see, our Mississippi 
Succeeds will expand the State’s education reform efforts to im- 
prove opportunities and outcomes for all students. 

Mississippi’s future will be shaped by the students of today and 
we are deeply committed to equipping them to learn, build, create, 
serve, and innovate. We believe in the capacity of our students to 
achieve and we believe in the ability of our teachers and schools 
to guide them to a successful future. ESSA is at the heart of our 
work. Thank you. 

[The statement of Ms. Wright follows:] 
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U.S. House of Representatives Committee on Education and the Workforce 
Every Student Succeeds Act Hearing 


Carey M. Wright, Ed.D., State Superintendent of Education for Mississippi 


duly 18, 2017 


Chairwoman Foxx, Ranking Member Scott, and Members of the Committee: thank you for the 
opportunity to testify about Mississippi’s work to implement the Every Student Succeeds Act 
(ESSA). | look forward to sharing my perspective as state superintendent of education for 
Mississippi. | am also president-elect of the board of directors of the Council of Chief State 
School Officers. 


ESSA has given Mississippi the opportunity to create a plan specifically designed for the 
students in our state. At the same time, the law provides guardrails to ensure our work is 
appropriately targeted toward improving educational opportunities and outcomes for all students 
and all schools. 


In Mississippi, we sought broad input from stakeholders over an 18-month period to craft a plan 
tailored to the needs of our students. We approached this process as an opportunity to connect 
and build upon the goals and strategies that are embedded in the Mississippi State Board of 
Education’s Strategic Plan, while leveraging the opportunities and expectations of ESSA. 


Mississippi’s State Board of Education’s Strategic Plan maps out a targeted approach to 
preparing students for college and careers and provides a firm foundation on which to build a 
strong plan to implement ESSA. Our state plan is called Mississippi Succeeds. We concluded our 
final public comment period on July 16, and are now in the process of preparing our plan for 
submission to the U.S. Department of Education in September. 


The Mississippi Department of Education has a history of working with a broad-based network 
of stakeholders who are actively engaged in policy advisement, development and implementation 
in our state. To gather input for our Mississippi Succeeds plan, we used our existing partnerships, 
formed new relationships and actively sought public comment from a wide and diverse range of 
individuals and groups. 


We launched a statewide listening tour in August 2016, which consisted of 15 public meetings 
throughout the state, six regional meetings with district superintendents and an online survey, 
The public meetings were held in the afternoon and evening in rural, urban and suburban 
communities, and participants included parents, college students, teachers, school and district 
staff and administrators, college and university faculty and staff, members of educational 
associations and advocacy groups, business leaders, school board members and public officials. 
Among our most active participants were advocates for underserved, majority African-American 
communities in rural, low-income areas of the state, parents of students with disabilities and 
teachers of English learners. Mississippi has a small, but growing, population of English 
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learners, and most of the teachers of English learners who participated in our feedback sessions 
were the only people in their schools whose work was dedicated to English learners. 


Through these meetings and the online survey, we gathered 7,300 feedback points through 
facilitated roundtable discussions about stakeholders’ priorities for student achievement, school 
quality and effective teachers and leaders. Key stakeholders also participated in the various 
workgroups we formed to work out the details of each section of our state plan. The overarching 
themes that arose from the meetings inform the work of the Mississippi Department of Education 
as well as our ESSA plan. 


Our ESSA advisory committee remains an active group and includes educators, policymakers 
and advocates, as well as the leaders of state agencies that are devoted to education, health and 
workforce development. This includes the community college board, Mississippi Institutions of 
Higher Learning, and the departments of health, mental health and human services. Other 
advisors include state leaders and legislators and representatives from the Mississippi Economic 
Council, the Mississippi Association of Educators, Parents for Public Schools and the NAACP. 
We also sought regular input from our Superintendents’ Advisory Committee, Principals’ 
Advisory Committee, Mississippi Teachers’ Council and our state Governor Phil Bryant. Our 
existing collaboration with Mississippi’s Workforce Investment Board ensured that our plan was 
aligned to our statewide effort to prepare Mississippi students for higher education, 
postsecondary opportunities and high-skill, high-wage jobs. We will keep all of our partners 
engaged in the implementation of our state ESSA plan through our regular meetings with 
stakeholders and the ESSA advisory committee. 


The robust participation of stakeholders helped Mississippi develop a strong plan to meet the 
requirements of ESSA. | am especially excited about the following aspects of our plan: 


* Our Teacher Leadership Initiative will provide effective teachers with opportunities to 
teach students and collaboratively lead colleagues to improve their practice. 

* Our early childhood education expansion will support early childhood educators in a 
variety of pre-K settings statewide to implement developmentally appropriate practices in 
their classrooms. This expansion is made possible through a grant from the W.K. Kellogg 
Foundation. 

* Our school improvement efforts will include a focus on building local capacity through 
professional development for teachers and administrators, improved community support 
through P-16 councils and other groups, and strengthened parent engagement through 
school-based activities. Mississippi will take advantage of the flexibility that ESSA 
provides by including student subgroup performance to identify schools for school 
improvement support. This will have the greatest impact on African-American students, 
who make up our state’s largest underperforming subgroup. 

* Our Career and Technical Education expansion will provide continuous computer science 
education to students in grades K-12 and provide high school students with the 
opportunity to graduate with a Career and Technical Education diploma endorsement that 
is of equal value to an academic endorsement. 
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« Asa long-term goal, Mississippi aims to eliminate the proficiency gap between A frican- 
American students and all students entirely, so that the proficiency rate for all student 
subgroups increases to 70 percent by 2025. 


All of these initiatives are dependent on federal support for public education. As a state chief, | 
understand that federal resources are limited and that states must be effective stewards of tax 
dollars. Mississippi's ESSA plan is built around the targeted and efficient use of federal funds to 
make the maximum impact on student achievement, especially for the most disadvantaged 
students, The proposed cuts to the federal education budget would greatly harm our ability to 
implement key programs under ESSA. In particular, the proposed cuts to Title Hf programs would 
devastate our efforts to improve teacher preparation and quality, particularly in high-need school 
districts that struggle to attract and retain qualified teachers, 


Mississippi has implemented aggressive reforms in recent years, including a literacy initiative to 
ensure students are proficient readers by the third grade and the implementation of the state’s 
first publicly funded pre-K program. These and other reforms, such as the implementation of 
high academic standards for all students, have pushed student achievement in Mississippi to 
improve at a faster rate than in many other states. We are excited about the opportunities that 
ESSA provides and continued federal support will help us build upon this momentum, 


Mississippi's ESSA plan is built upon a strong foundation that includes rigorous academic 
standards for all students, aligned assessments to track student achievement and an 
accountability model that clearly measures the performance of our schools and districts. Our plan 
also builds upon the significant investments Mississippi has made in early childhood education, 
literacy, career and technical education, advanced coursework opportunities for students, and 
professional development for teachers. All of these initiatives have broad stakeholder support 
and have resulted in improved student outcomes. 


Students are achieving more because Mississippi's leaders and education stakeholders are 
committed to a singular vision of preparing our students for the future. The Mississippi State 
Board of Education, state elected leaders, the Mississippi Department of Education and local 
school districts and communities have joined forces to enact bold education reform efforts that 
are producing unprecedented outcomes. The changes have been aggressive, and teachers, 
administrators and communities have embraced the state’s vision to make major student 
achievement a reality. 


Our Mississippi Succeeds plan to implement ESSA will expand the state’s education reform 
efforts to improve opportunities and outcomes for all students. Mississippi’s future will be 
shaped by the students of today, and we are deeply committed to equipping them to learn, build, 
create, serve and innovate. We believe in the capacity of our students to achieve their highest 
goals and in the ability of our teachers and schools to guide them to a successful future. ESSA is 
at the heart of our work, 
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Chairwoman Foxx. Thank you, Dr. Wright. Thanks again to all 
of our witnesses. 

Mr. Wilson, you are recognized for 5 minutes for questions. 

Mr. WILSON of South Carolina. Thank you, Chairwoman Virginia 
Foxx, for your extraordinary leadership providing for this hearing 
today. And I want to thank each of you for being here today. I espe- 
cially appreciate your service because I am the very happy husband 
of a dedicated teacher. And I want to keep her happy, too, so thank 
you for what you are doing. 

And, Dr. Wright, South Carolina students greatly benefit from 
career and technical education with partnerships with companies 
such as BMW, MTU, Michelin, and Boeing, and the South Carolina 
Technical Education System. South Carolina has been very fortu- 
nate with a division of technical education being promoted under 
the leadership of State superintendents of education from Dr. Bar- 
bara Neilsen to today with the Honorable Molly Spearman. 

In your testimony you include several aspects of your State’s 
plans to meet the requirements of the Every Student Succeeds Act, 
and you cited the efforts of career and technical education. Can you 
elaborate your promotion of career and technical education for the 
citizens of Mississippi? 

Ms. WRIGHT. Yes, I will. About 65 percent of the jobs that are 
currently available in our State are requiring metal skills. And so 
we have formed a committee that is working not only with our 
State Workforce Investment Board, but also on the implementation 
of the Workforce Investment Act. We have four sectors in our State 
and what we have done is we have established groups in each of 
those sectors to work directly with the businesses in those sectors 
so that we can then come back and design CTE plans that will 
allow our children to go, starting in high school, graduate from 
high school, and go immediately into the workforce. Our State 
needs that immediate piece and that is what we have got planned 
as well. 

Mr. WILSON of South Carolina. And what a meaningful and ful- 
ae life you help young people achieve, so thank you for what 
you do. 

And, Dr. Pletnick, I want to thank you for your testimony on a 
very important issue and that is local elected school boards. And 
I know that my view is that they work best for our students. I 
learned this firsthand. My dad was a school board member in 
Charleston. I served in the State senate working with school 
boards and found out the extraordinary diversity within a single 
district that these school boards have to address, and they are hard 
work, but the extraordinary dedication of school board members. 

Your testimony promotes, again, moving from one size fits all. 
Can you provide more detail on how the Every Student Succeeds 
Act will help restore local control of education and allow educators 
to address the unique needs of individual students? 

Ms. PLETNICK. Member Wilson, thank you for that question. In 
the Dysart Unified School District, we utilize a strategic planning 
process, so our community gives us that feedback. We work with 
our business partners. We work with our parents to ensure that we 
are meeting the needs of our students in our local community. And 
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ed school board is that connection. So they are the elected offi- 
cials. 

The ESSA has allowed us then to work through our State to en- 
sure that the multiple measures that we are utilizing speak to 
those needs of our students, certainly our underserved population, 
but really for all students making certain that they are future 
ready. 

We, too, have a very strong career and technical education pro- 
gram because we hear from our local community and from our 
business partners that there are opportunities. We have Luke Air 
Force Base in our backyard. We recently took a tour and it takes 
2 billion lines of code to run the F—35. They have that mission. And 
so we are ensuring that our students have opportunities with cod- 
ing and other pieces. 

That is something that is a strong piece in our strategic plan as 
we move forward. And so again, ESSA provides us that opportunity 
to look at multiple indicators and those that would truly serve our 
underserved population, but all of our students as well. 

Mr. WILSON of South Carolina. And thank you for, again, looking 
out for all students. As I served in the State senate, now Congress, 
I represent a district, Lexington 1. The diversity there, you have 
resort areas. You have very upscale subdivisions. You have normal 
middle class subdivisions. You have a small town. You have rural 
communities and then you have agricultural communities. That is 
in one district. And so the local school board is just so important. 

And, Ms. Nowicki, I want to thank you for your service and your 
promotion of flexibility. Can you explain how flexibility of the act 
would provide for a different approach in adopting performance in- 
dicators? 

Ms. NOWICKI. Sorry, sir. You are asking how the flexibility of the 
act could? 

Mr. WILSON of South Carolina. Assist with performance indica- 
tors - in determining performance indicators. 

Ms. NowICKI. Sure, sure. So there were a couple of different ex- 
amples in our report where States were making different decisions, 
I think, around performance indicators. The way they defined sub- 
groups, how they were choosing to use summative or overall rat- 
ings versus individual ratings on indicators. 

I think it provides flexibility for States to do whatever they think 
makes sense for them in their local context while providing suffi- 
cient guardrails to protect vulnerable populations and subgroups. 

Mr. WILSON of South Carolina. Thank you very much. 

Chairwoman Foxx. Thank you, Mr. Wilson. 

Mr. Courtney, you are recognized for 5 minutes. 

Mr. CouRTNEY. Thank you, Madam Chairwoman, and thank you 
for holding this really important hearing, but I want to join the 
ranking member in saying how I think a lot of us feel frustration 
about the fact that the Secretary of Education has not yet appeared 
before this committee. It has been 6 months into this administra- 
tion. We have had a budget out since May. And looking historically, 
we have always had the Secretary of Education appear before this 
committee to take questions from members about issues of the day. 

And clearly, what we are talking about today for all of us listen- 
ing to our commissioners back home, stakeholders who have been 
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working hard on implementation of ESSA, there is a lot of confu- 
sion out there, and we need people from the Department, particu- 
larly the person who is in charge, where the buck stops, to answer 
questions about where are we going. 

The ESSA was signed into law on December 10, 2015. It was ac- 
tually a really inspiring tableau to see President Obama signing 
that law with Senator Lamar Alexander, Republican leader in the 
Senate, Mr. Rokita from our committee was standing behind the 
president. Again, it was a lot of hard work that went into that to, 
again, achieve some of the goals that some of the witnesses have 
talked about here today. 

But fast-forward and it is really not that early in the implemen- 
tation of the law to where we are today in 2017. There is a lot of 
confusion out there about just the mixed messages and signals that 
are coming out of the Department as States are working hard to 
try and, again, achieve the goals of this legislation. It has not been 
helped, by the way, by the fact that the Republican majority 
chainsawed out of the Federal law the regulations, back in May, 
with the Congressional Review Act enactment that President 
Trump signed into law. That, again, just completely eliminated, 
you know, the roadmap that had been put into place by the Depart- 
ment. 

Again, I had questions about some of those regs. But the fact is 
now we have a black hole in the Federal law in terms of, you know, 
how ESSA is structured and designed. And when you talk about 
confusion out there, frankly, the majority added to that confusion 
by, in my opinion, just indiscriminately butchering the regs that 
were in place. 

And so that is where we are today. Again, my State of Con- 
necticut did everything right, I think, in terms of pulling together 
stakeholders. They worked like, you know, very diligently in terms 
of coming up with a plan which was submitted. Again, it got kicked 
back about a month or so ago. 

Talking to the folks in that Department, you know, they want to, 
you know, work collaboratively, but, frankly, there is tremendous 
confusion about, you know, which direction they are supposed to go 
in. And frankly, again, it is just another reason why the Secretary 
should be here today answering questions to all of us about where 
she, in fact, intends to take this Department. 

We know when there’s confusion in Washington going back to the 
infamous words of Deep Throat during the Watergate scandal, fol- 
low the money. Again, Mr. Lovell, I would just like to sort of follow 
up your comments. We obviously have seen a budget come out of 
this administration in terms of their priorities as far as title I, title 
II, afterschool. Again, one of the goals of ESSA was to move away 
from the punitive approach of No Child Left Behind and to try and 
help districts who had been identified as underperforming. 

And again, I just would ask you to comment further about, you 
know, cutting these programs, in fact, removes the resources that 
ESSA was built around in terms of trying to help school districts 
that are struggling. 

Mr. LOVELL. Thank you very much. I could not agree more. In 
fact, it is interesting. So one of the issues that came up just a few 


56 


minutes ago, Mr. Wilson, you brought up career and technical edu- 
cation. And I think that is a huge opportunity within this law. 

And, first, let me applaud the committee for its works on the re- 
authorization of the Perkins law. Unfortunately, because of the lev- 
els of funding that are being proposed for things like career and 
technical education and the cuts therein, we are not able to imple- 
ment a lot of those programs. 

Right now, with States having the ability to design their plans 
and implement them, the integration of rigorous academics with 
CTE is a major opportunity. There is language specifically in the 
law that you wrote within title I that allows States to do this and 
not only that, you allowed States to use up to 3 percent of their 
funding for direct student services. 

And one of the uses of the direct student services funding that 
you allowed was the provision of CTE that leads to an industry-rec- 
ognized credential. Very few States are planning to use this 3 per- 
cent set-aside for direct student services. And why? Well, it is be- 
cause they feel like it cuts into their title I budget. 

So by level funding title I by cutting elsewhere, that means the 
title I dollars are going to have to go towards other things. And it 
means that States do not have the ability to really carry out the 
vision of the law that this committee set. 

Mr. CourTNEY. Thank you. I yield back. 

Chairwoman Foxx. Thank you, Mr. Courtney. 

Mr. Walberg, you are recognized for 5 minutes. 

Mr. WALBERG. Thank you, Madam Chairwoman, and thank you 
to the panel being here. And I would concur with Mr. Courtney as 
well that it would be a great opportunity and time when we have 
a chance to hear from our Secretary of Education. I believe my col- 
leagues would be impressed with her as much as I am impressed 
with her abilities and yet, we also hope that there is a stopping of 
the stonewalling and blocking of confirmations that would assist 
her with people who can be undersecretaries, assistants, et cetera, 
to help in the process moving forward with something she has iden- 
tified, ESSA, something she wants to implement as intended, as we 
intended fully. So I look forward to that as well. 

But today we have these witnesses here and, Ms. Nowicki, thank 
you for being here. In your testimony you mentioned that the De- 
partment is considering additional areas of guidance that might be 
needed for States as they implement ESSA. Has the Department 
said what those areas might be and how will they determine if that 
additional guidance is, in fact, needed? 

Ms. NOWICKI. Yes, sir. The Department has said that they are 
conducting a review of all of their current guidance that is avail- 
able and looking for gaps or areas where States might need addi- 
tional assistance. They have various ways to do that. They have 
mentioned webinars that they hold and meetings that provide a 
forum for States to share some concerns or some areas where they 
may need guidance. 

In our work, stakeholders who are working directly with States 
developing their plans mentioned a couple of areas as well. 

Mr. WALBERG. If you could highlight some of those? 

Ms. NOWICKI. Surely. One is how to select evidence-based strate- 
gies and measure their efficacy in the States. It is not unusual 
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throughout government and in the States for there to be a lack of 
capacity in terms of knowing how to evaluate strategies. So that 
was one area. 

A second area was noting that because ESSA provides much 
more funding flexibility than did NCLB, helping States understand 
the broad funding flexibilities that they do have available to them 
and the law would be useful for States. 

Mr. WALBERG. And those flexibilities are just name a few of 
those? Flexibilities 
Ms. Nowicki. Funding flexibilities to combine funding streams 
under the law in ways that they were not able to do under NCLB. 
Mr. WALBERG. With local States, et cetera? 

Ms. NoOwIckI. Yes, different Federal and State local funds to- 
gether. 

Mr. WALBERG. Okay. Ms. Nowicki, this is obviously an initial 
look at early implementation of ESSA, but do you believe there is 
future work GAO could do on this topic as States put the law into 
practice over the next few years? 

Ms. Nowicki. Absolutely. I think in the shorter run two areas 
may be important. One, I think it will be important to pay atten- 
tion to how Education’s monitoring protocols are shaping up. ESSA 
obviously encourages a much more State-driven approach in devel- 
oping their plans and we would want to see monitoring protocols 
reflect that. Yet developing them in a way that also holds States 
accountable for Federal requirements may take some doing. 

Two, I think it will be important to look at how States are mak- 
ing the public aware of differences in school and district perform- 
ance in their States and whether key stakeholders find that infor- 
mation useful. We like to say at GAO that data is only useful if 
it is used and that usefulness is in the eye of the beholder. So if 
stakeholders and parents are not able to access the information or 
do not find that it is telling them things that they would like to 
know, I think it would be important to know that. 

Mr. WALBERG. Well, I appreciate that and, Madam Chairwoman, 
I appreciate the fact as we heard that testimony we talked more 
about stakeholders at the local and State level as opposed to Fed- 
eral and that is a good thing. 

Dr. Pletnick, thanks for being here. ESSA returns significant au- 
thority to school districts to determine how to intervene in and how 
to improve low-performing schools, which is important to consider 
if we are expecting education to reach the masses of our country. 
What initiatives are in place in your district or are you working to 
implement that will do just that? 

Ms. PLETNICK. Member Walberg, we have put in place a number 
of initiatives. First of all, when we are looking at each of our 
schools we take a proactive approach rather than reactive ap- 
proach. So we make sure that the programs that we have in place 
are providing that high-quality education. We use an RTI process 
in which we have tiered intervention. So tier 1 is that classroom. 
We need high-quality teachers delivering high-quality instruction. 

And then if we do have our struggling students, especially in our 
underserved populations, we need to evaluate what it is their spe- 
cific needs are. Again, I believe ESSA versus No Child Left Behind 
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allows us to focus on that individual student, not just the aggre- 
gate. 

So we provide those interventions sometimes through interven- 
tionists. We have online programs because we really want access 
24/7 for our students in order to provide the supports they need. 
And again, the intensity of those interventions continues to grow 
as we work with the individual student to fill those needs. 

The other thing that we are doing across the district is personal- 
ized learning. So we are looking at what the students’ strengths 
are, certainly their area of challenges, but also their interests be- 
cause we need to engage our students in their learning. We need 
them to own their own learning. 

So we are working on ways to really not only have them own 
that learning, understand about progress, but also ways that we 
could use space and place and pace differently. 

Chairwoman Foxx. Dr. Pletnick, I am going to have to ask you 
to wind up. 

Ms. PLETNICK. Thank you. 

Chairwoman Foxx. Thank you very much. 

Mr. WALBERG. Thank you. I yield back. 

Chairwoman Foxx. Mr. Polis, you are recognized. 

Mr. Po.is. Thank you, Chairwoman Foxx and Ranking Member 
Scott, for holding this important education hearing. You know, 
when I first ran for Congress several years ago, one of the main 
reasons I ran was to fix our outdated education policy, No Child 
Left Behind. During my time on the State Board of Education in 
Colorado and as a school superintendent, I saw a lot of the flaws 
of No Child Left Behind firsthand and I was thrilled to work on 
the Every Student Succeeds Act in this committee, in the con- 
ference committee. A number of bills that I wrote were incor- 
porated into that bill and I was very excited by a step forward that 
I think everybody felt was better than its predecessor. 

Now, I am troubled now by some of the comments I have heard 
from my Republican colleagues, who seem to be suggesting that 
since we passed the Every Student Succeeds Act, States can some- 
how do whatever they want. The goal of the Every Student Suc- 
ceeds Act was to maintain, of course, our civil rights, guardrails, 
and safeguards, and, in fact, to provide school districts and States 
the flexibility to do what works, but not the flexibility to fail and 
to do nothing. 

No one here voted to let States and school districts fail when we 
passed the Every Student Succeeds Act. So we should not be sur- 
prised the Department of Education is providing meaningful and 
positive feedback to the States. It helps them to develop and imple- 
ment their ESSA plans and that they will only approve plans that 
meet the law’s requirements. That was the requirements that we, 
as a body, you know, overwhelmingly voted to include in the actual 
law. 

Dr. Pletnick, I wanted to thank you for being here today. Really 
one of the ironies that I see is while the Department of Education 
is trying to do a good job providing feedback to States, at the same 
time, both by the President’s budget and the congressional Repub- 
licans’, they’re slashing funding for some of the key programs, and 
I want to highlight one in particular. 
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Colorado, like many other States, went through an extensive 
stakeholder engagement process to develop title II as part of our 
State plan for teacher and professional development. Last week, 
House Republicans moved forward with the budget that eliminates 
funding for title II, part A, the real significant funding stream for 
teacher professional development and classroom size reduction. 

How can States deal with this uncertainty around the use of 
funds for teacher and professional development and classroom size 
reduction that are already included in their plans if the funding 
goes away? 

Ms. PLETNICK. Thank you for that question. That is a problem. 
When there are funding cuts that means either the elimination or 
cutting back on programs and many of these are critical. I can tell 
you in the State of Arizona for title II the impact would be about 
$16.9 million in professional development. That is supporting more 
than 34,000 educators. Class size reduction would be impacted and 
that would impact about 137 positions that we have. And statewide 
the impact of the total title II elimination would be about $32.5 
million. So it would have a devastating impact in those areas. 

Mr. Potts. And given that those education plans included the use 
of that money for teacher training classroom reduction, does that 
mean that it will send, in effect, States back to the drawing board 
for their title II plans and their teacher training plans? 

Ms. PLETNICK. I think that would be correct because our budgets 
are very tight and so, again, when we have elimination of funding, 
that means you have to go back and look at your programs. And 
quite frankly, all of the programs that we have in our own district 
I can say are essential, including those that we provide for profes- 
sional development. 

Mr. Po.is. And for Mr. Lovell I wanted to ask, you know, one 
area where we also made progress in the Every Student Succeeds 
Act is early learning, the most important, the studies show, invest- 
ment in early childhood education. We authorized a new preschool 
development grant program. The law will hopefully facilitate better 
collaboration between early learning and K-12. Can you talk about 
how States so far are taking advantage of new opportunities to 
support early learning under ESSA and what lessons we can learn 
from some of the States that have submitted their early learning 
components and their plan? 

Mr. LOVELL. Thank you, Mr. Polis. Well, really the answer to 
that question goes back to your first question, which is that plans 
that might be in place or ideas that we might have are going to 
be severely undercut if there is no resources to fund them. And so 
you have cuts that are being proposed both by the administration, 
by the House Labor-H Committee, you have got cuts being pon- 
dered for Medicaid. You put all that together and it is hard for 
States to really envision something robust and necessary and costly 
like a robust early childhood program. 

Mr. POLIS. Yeah, and I think, you know, to clarify what you are 
saying, when our committee writes the authorizing legislation, the 
Every Student Succeeds Act, it’s only as good as the funding that 
actually funds those programs that we authorize. 

Dr. Wright, can you briefly share more about what Mississippi 
is doing in early learning? 
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Ms. WRIGHT. Absolutely, and thank you for that. We passed a 
law establishing early learning collaboratives. That was the first 
time that we went into that foray. We are also looking and moni- 
toring the results of that. We, with our kindergarten assessment, 
we realized that two-thirds of our children that were entering kin- 
dergarten were not prepared. So we knew that there was a need 
for pre-K. 

And so now we are also reaching out to all of the pre-K, public 
or private, in order to provide them with professional development. 
We do that free of charge to anyone that teaches three- or four- 
year-olds in our State. And we honestly believe that it is a lever 
that is going to make a difference in the State of Mississippi. So 
we have a lot of interest in that and a lot of infrastructure that 
we are putting toward that. 

Mr. Potts. I thank the gentlelady. And just in brief closing, I will 
just inquire of the chair if we have invited or plan to invite Sec- 
retary Devos for an oversight hearing before our committee as well. 
And I will yield back with that inquiry. 

Chairwoman Foxx. The gentleman yields back. We do plan to in- 
vite her. 

Mr. Guthrie, you are recognized for 5 minutes. 

Mr. GUTHRIE. Thank you, Madam Chairwoman, for yielding. I 
appreciate the time. And this question is actually—is based on the 
testimony from Dr. Wright but, Dr. Pletnick, I would like for you 
to answer this as well, but it is based on Dr. Wright’s testimony 
would be applicable I am sure. It says one in Kentucky, Education 
Commissioner Stephen Pruitt in the Kentucky Department of Edu- 
cation, found similar successes in hosting town halls across the 
State, engaging partner organizations, and accepting public com- 
ment in order to craft a new assessment of the accountability sys- 
tem. 

When it was all said and done, the Department received an input 
of 6,000 Kentuckians on the matter. Based on the feedback you re- 
ceived in your town halls, what were the biggest changes stake- 
holders wanted to see reflected in your State plan? 

Ms. WRIGHT. They wanted to see more communication between 
schools and districts. They also were interested in not necessarily 
defining teacher effectiveness by years of experience and licensure, 
but by linking it more to student outcomes. And that we heard loud 
and clear. They really viewed an effective teacher as one that pro- 
duced positive outcomes in children. 

And so those are two key pieces, if you will. There were several, 
but those were two that we take to heart. We are already in the 
process of designing resources that we have continued to push out 
to our districts and our schools to help them better engage with 
parents at the local level. And also we are revising our whole 
teacher evaluation system to really look at it as more of a profes- 
sional birth system and driving that around linking it to our stu- 
dent outcomes, which is what we are hearing from our constitu- 
ents. 

Mr. GUTHRIE. Okay, Dr. Pletnick, did you have similar experi- 
ences? 

Ms. PLETNICK. We did, and there was a great deal of discussion 
around those multiple indicators and really redefining ready, what 
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future-ready means. So there was discussion about the career and 
college index. There was discussion about what are those other sig- 
nificant and meaningful indicators that would keep us transparent 
and help our parents, our community understand the account- 
ability system and what student success looks like. 

Mr. GUTHRIE. Okay. What kind of examples of indicators did 
you—were you —— 

Ms. PLETNICK. So in the end we, as I had mentioned earlier, we 
do have college and career indicators. We do also have indicators 
around other national assessments that are utilized as kind of 
opening or gatekeepers into higher education. We do have ad- 
vanced coursework as well. 

So there really is a very long list of indicators that are now con- 
sidered as part of our accountability. 

Mr. GUTHRIE. How are you, once this is all implemented and 
moving forward, planning, like, additional town halls to try to con- 
tinue to seek feedback for continuous improvement or what kind of 
methods are you going to try to still have stakeholder feedback? 
Continue what you are doing? 

Ms. PLETNICK. I would hope that at our State level with our state 
department, and there is no reason to believe that won’t be the 
case, that we will continue to look at what is in place, analyze the 
data we are collecting, and see how we can refine and improve 
moving forward. 

Ms. WRIGHT. And that is exactly what Mississippi is planning on 
doing. We want to stay engaged with our stakeholders. They have 
invested a lot of time and energy in this. I have also got a very 
large ESSA advisory council that I intend to keep onboard with 
very diverse group of folks. So we have got to make sure that we 
are meeting the needs of our constituents and those are two very 
strong ways that we can do that. 

Mr. GUTHRIE. Thank you very much. And I have one for Ms. 
Nowicki. I have heard concerns from the Kentucky Department of 
Education that the department has provided that your Department 
here, the Federal Department, has provided inconsistent feedback 
to States that submitted plans early when compared one to an- 
other. Is this something the GAO has found to be true? And if so, 
what is the Department doing to provide consistent guidance? 

Ms. NOWICKI. Yes, sir. So GAO, as you know, does not have a 
statutory or other role in reviewing State plans. At the time that 
we did our work there were only a couple of plans that had been 
submitted in draft for feedback. So we did not have any informa- 
tion from the Department about feedback on the plans at the time 
we did our work. 

Mr. GUTHRIE. Do you have a—well, okay. So you did your study 
before you would have been able to see whether there was incon- 
sistent —— 

Ms. NOWICKI. Yes, sir. 

Mr. GUTHRIE.—feedback, one plan against one and one plan 
against another? That is something that we hopefully will be able 
to look into as we move forward. 

Mr. LOVELL. I mean, if I may? 

Mr. GUTHRIE. Yeah. 
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Mr. LOVELL. I can provide some thoughts on this. I mean, I think 
that there definitely were areas where feedback was inconsistent. 
I think part of it has to do with the fact that without the regula- 
tions, there are fewer specific rules around some of the vague areas 
in the law. 

So one area where—and a question came up earlier around areas 
that the Department could provide future guidance in. I think one 
area, as Dr. Pletnick was describing, the various indicators that 
can be selected, this is an area where the law gives States flexi- 
bility and even provides some examples of the indicators that 
States can use. 

A number of States are interested in really prioritizing college 
and career readiness. So they are including things like access and 
performance in advanced placement, international baccalaureate, 
dual enrollment, early college. Feedback to one State was some- 
what negative about the State’s approach to this and we are fearful 
that feedback like that without additional guidance as to how those 
things can be included in the accountability could put the freeze on 
State innovation and doing what we all want States to be doing. 

After all, the law specifically says that States can include access 
and performance on advanced coursework. And then when a State 
tried to do it, they got a little pushback from the Department. 

Chairwoman Foxx. Mr. Lovell? 

Mr. LOVELL. So I think that is an area where you have some ad- 
ditional guidance. 

Chairwoman Foxx. Mr. Lovell? 

Mr. GUTHRIE. Thank you. That was helpful. My time is expired 
and I yield back. Thank you for those comments. 

Chairwoman Foxx. Yes, sir. 

Ms. Bonamici, you are recognized for 5 minutes. 

Ms. BONAMICI. Thank you, Chairwoman Foxx and Ranking Mem- 
ber Scott, for holding this important hearing about the implemen- 
tation of the Every Student Succeeds Act. I want to also join my 
colleagues who expressed their opinion, and I agree that it would 
be very helpful to hear from the Secretary and the Department as 
we are talking about implementation. 

I worked on education issues in my home State of Oregon at the 
local level and then in the State legislature and it quickly became 
clear that the real work needed to be done at the Federal level. 
And so at the top of my legislative agenda list when I joined Con- 
gress was rewriting No Child Left Behind. And I was thrilled to 
serve on the committee when we worked on Every Student Suc- 
ceeds Act and on the conference committee and be there at the bill 
signing and it was a great day. And it was looking forward to im- 
plementation. 

So needless to say, I was disappointed earlier in the year when 
the majority instead of talking about which regulations were prob- 
lematic and which they could support, instead got rid of all of them 
through the Congressional Review Act and blocked important regu- 
lations related to statewide accountability systems, consolidated 
plans, and data reporting. 

And then at the same time, the new administration, left without 
their implementing regulations, attempted to rush through revised 
guidance for peer reviewers, and there was a modified template for 
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State plans, and new explanatory documents, and all of this was 
taking place less than a month before the initial deadline for sub- 
mitting the plans, and after many States were well on their way 
to completing their plans. 

So I do not think we should be surprised that there has been un- 
certainty and confusion. Disappointed, yes, but not surprised. And 
in fact, without the ESSA regulations, now there’s a conversation 
about which NCLB regulations are still in effect and what do we 
do about those. 

So what we really need is for the Department to play a reliable 
role in enforcing compliance with the statutory requirements and 
the law and clearing up areas of ambiguity and helping States take 
advantage of the flexibility that is such an important part of the 
law. And I know in my home State of Oregon, I had conversations 
as they were working on their plan about the lack of certainty. 

And they appreciate the flexibility, but do not want to go down 
a path and then months later be told that you can’t go down that 
path. So Mr. Lovell, in the Department’s feedback letter to my 
State of Oregon, the Department noted that Oregon’s plan proposed 
to include in the students with disabilities subgroup, students who 
had previously been identified as students with disabilities, but 
have exited that status recently. The Department said Oregon can- 
not use that flexibility even though it was permitted in the ac- 
countability regulations that were finalized when they were writing 
their plan. 

So can you describe other instances where a State has actually 
lost flexibility because of Congress’s action to block important im- 
plementing regulations? 

Mr. LOVELL. Sure. So one area where we lost flexibility is in the 
ability of States to provide credit to their schools where kids are 
performing above proficiency. So we would like to be able to really 
prioritize higher thinking skills and one way that you could that 
is by providing credit for students that are performing above pro- 
ficiency. The law very specifically says that kids should be—that 
the academic achievement indicator needs to measure proficiency. 

So it is questionable as to whether you can actually provide cred- 
it for students that are performing above proficient. As a result, 
you have some States, one in particular that I could think of, 
where they are not measuring proficiency at all, which is also not 
consistent with the law. 

Ms. BONAMICI. Right. 

Mr. LOVELL. So I totally agree with you, the removal of the regu- 
lation on top of a new template less than 30 days before the appli- 
cations were due did cause a decent amount of confusion. And I 
think that had the regulation been in place, we wouldn’t see some 
of the inconsistences that we are seeing. 

Ms. BonamIclI. Thank you. And I also want to follow up, we have 
heard a lot of talk about the importance of stakeholder engagement 
and that was a really critical component of the Every Student Suc- 
ceeds Act. And, Mr. Lovell, the Department’s revised template does 
not include explicit questions about stakeholder engagement, as 
well as other important requirements of ESSA, including provisions 
related to homeless and foster youth. 
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And I know you have reviewed the State plans. And how has the 
Department’s decision to exclude those statutory requirements af- 
fected the development of State plans? And based on your review 
of State plans, are States actually meeting these requirements of 
the Every Student Succeeds Act? 

Mr. LOVELL. So thank you very much for that question. You 
know, if it is not written, you don’t whether it is happening or not. 
And so I agree that especially around some of our most vulnerable 
kids, our homeless students, and our kids in foster care, not having 
specific questions for those students means that we don’t know 
what is going to be happening. That said, just because it is not in 
the template doesn’t mean that those requirements don’t exist. 

Ms. BONAMICI. Right. 

Mr. LOVELL. So it is very important that we still carry out and 
oversee the implementation of those provisions even if the ques- 
tions were not asked in the template. 

Ms. BonamiclI. Thank you. More need for certainty and, Madam 
Chairwoman, as I yield back, I want to take just a moment to ac- 
knowledge my senior legislative assistant, Adrian Anderson, who 
has worked with me for several years on this committee on the 
Every Student Succeeds Act especially. And he is leaving at the 
end of the month to go to law school and I just want to thank him. 

Chairwoman Foxx. Thank you, Ms. Bonamici. 

Mr. Barletta, you are recognized for 5 minutes. 

Mr. BARLETTA. Thank you. Dr. Pletnick, thank you for your testi- 
mony and for being here today. There are studies showing that 
poor attendance can impact academic achievement, ultimately lead- 
ing to lower reading and math scores. We know that chronic absen- 
teeism negatively affects students’ success and this has led to some 
States to propose absenteeism as an additional accountability 
measure in their ESSA plans. 

We also know there is evidence that quality afterschool and sum- 
mer learning programs are cost-effective strategies in increasing 
student attendance at all grade levels. I have seen this firsthand 
through an afterschool organization in my district, the SHINE Pro- 
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SHINE focuses on project-based learning with an emphasis on a 
STEM curriculum. It gets kids excited about learning again. And 
it is proven to work. Ninety-two percent of SHINE students had ex- 
ceptionally good or satisfactory school attendance. Ninety-seven 
percent of students indicated they were excited about STEM and 
the numbers of students who said they would like to study math 
or science in college increased by 14 percent. 

The numbers speak for themselves. When students are excited 
about learning, they show up for class and feel personally invested 
in their education, setting themselves up for success down the road. 
Can you speak to how State ESSA plans may be encouraging 
school districts to leverage title I and title IV funds to provide 
afterschool and summer learning opportunities to their students, 
and how can districts partner with community-based organizations 
to address problems like chronic absenteeism? 

Ms. PLETNICK. Thank you for that question. And in fact, in Ari- 
zona, that was one of the indicators that we wanted to include be- 
cause we do see some of those same results that you have. And I 
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can speak to my own district, but also neighboring districts, with 
our underserved populations especially, having those afterschool 
opportunities serve many purposes, but certainly engage students 
in their learning. And we, too, have opportunities to have coding, 
to have rere those really critical skills that students enjoy being 
a part of. 

What we have also seen is through those programs we have in- 
creased parent involvement because they are able to engage with 
their students in those activities. So truly by using our funding, 
title I, title IV, those types of programs we believe are having a 
positive impact academically on our underserved populations. 

Mr. BARLETTA. Thank you. I yield back the balance of my time, 
Madam Chair. Thank you. 

Chairwoman Foxx. Thank you, Mr. Barletta. 

Mr. Takano, you are recognized for 5 minutes. 

Mr. TAKANO. Thank you, Madam Chair. 

Ms. Pletnick, well, first of all, congratulations on being named 
president-elect of the AASA. Given the fact that you must be famil- 
iar with that organization’s position on the ESSA regulations rolled 
back under the CRA in February, I was hoping you would be able 
to explain the reversal of AASA’s position. 

When the final regulations regarding accountability were re- 
leased, your organization endorsed them, recognizing that your 
three major concerns were addressed. Then in February, when they 
were up for discussion and rollback, your organization supported 
the CRA. What changed between November and February and why 
this dramatic turnaround? 

Ms. PLETNICK. Again, as an organization we truly support what 
is in the best interest of all of our schools. And certainly, when the 
regulations—I had an opportunity, in fact, to testify in front of a 
Senate committee about those regulations. 

And again, although there were some changes that were made in 
terms of those, we did not feel that, indeed, as a package there 
weren't some issues or concerns with those. So I think AASA’s posi- 
tion was about making certain that we have the most flexibility 
and autonomy as we move forward in order to implement ESSA in 
terms of the spirit of the law. 

Mr. TAKANO. But, Ms. Pletnick, I still don’t understand why the 
change. I mean, you have spoken in very general terms. What ex- 
plains this reversal of position? You supported the regulations 
when they were first promulgated and then suddenly your organi- 
zation turns around, does a reversal. They support the Congres- 
sional Review Act overturning those regulations. 

I mean, in my mind, the regulations allowed for the implementa- 
tion of ESSA. What is your—I mean, I don’t have a sense of you 
explaining the one. Will you give an adequate explanation? 

Ms. PLETNICK. I apologize for not being clear. Again, I am speak- 
ing in broader terms in terms of when you look at 
Mr. TAKANO. Is there one specific, one or two specifics you can 
name? 

Ms. PLETNICK. Again, I would ask that I be allowed to provide 
that opportunity for the record going back to AASA —— 

Mr. TAKANO. Okay. 

Ms. PLETNICK.—in order to provide that. 
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Mr. TAKANO. That is fine. That is fine. I would love to hear those 
specifics, read those specifics. Between both the President’s budget 
proposal and the fiscal year 2018 House Labor Bill, more than $2 
billion in funding for title I-A of ESEA, the largest Federal fund- 
ing stream directly supporting teachers and school leaders in 90 
percent of school districts will be completely eliminated, completely 
eliminated. In your role as superintendent and now being presi- 
dent-elect for AASA, how would the elimination of title II-A fund- 
ing nationwide affect your abilities to support teachers and imple- 
ment ESSA? 

Ms. PLETNICK. I would share that the most critical resource that 
we have in our schools are our human resources and that is espe- 
cially true of our teachers who touch our students every day. So not 
having that funding in order to support the professional develop- 
ment that would allow them to continue to ensure that we have the 
eh aeieeiee needed to serve our underserved populations as well as 
all. 

Also monies are used in our districts to reduce class size. So 
again, an increase in class size would be an issue if title II was 
eliminated. And certainly, what we would find is that it would be 
very difficult for schools to continue programs like peer mentoring, 
other things that title II provides opportunities for us to do without 
that funding. 

Mr. TAKANO. So is it fair to say that your organization would 
strongly support restoration of this funding? 

Ms. PLETNICK. Yes. 

Mr. TAKANO. Thank you. I yield back, Madam Chair. 

Chairwoman Foxx. Thank you, Mr. Takano. 

Mr. Allen, you are recognized for 5 minutes. 

Mr. ALLEN. Thank you, Chairwoman Foxx, and thank you for 
being here with us today. You know, ESSA was a significant bipar- 
tisan achievement that we initiated to empower State and local 
education decision-making while attempting to restrain some of the 
ay of the Secretary of Education, particularly at the local 
evel. 

Since the law has been enacted, my State of Georgia has been 
diligent working with over 140 stakeholders to create a State plan. 
Of course, we call this the bottom-up approach rather than the 
Federal top-down approach. Georgia has gone to great lengths to 
maximize the flexibility provided by ESSA to support its vision of 
offering a holistic education to each and every child in the State. 

Of course, I support this vision and our State’s commitment to 
engaging Georgians in this plan development. Of course, I look for- 
ward to working with the Department and its interpretation of 
ESSA does not exceed the intent and limits of the law. Our goal 
here is to achieve every child succeeds. 

So Dr. Wright, have you been encountering some of the same 
problems that Georgia has as far as, you know, bringing stake- 
holders together and then submitting the plan to the Federal De- 
partment of Education and getting pushback? 

Ms. WRIGHT. We have not yet submitted our plan. We are going 
to be submitting in September, but we have had absolutely no 
problem gathering stakeholders. There is a lot of people out there 
that want to have their voice heard around what they consider 
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most important for our children. And so that has been a very excit- 
ing and invigorating process actually meeting all across the State 
with our stakeholders. 

Mr. ALLEN. We have experienced that in Georgia as well, which, 
like you said, is a very good thing. 

Ms. Pletnick, what has your experience been as far as working 
with oe Department of Education, the Federal Department of Edu- 
cation? 

Ms. PLETNICK. In terms of the Federal Department —— 

Mr. ALLEN. Trying to get a plan approved. Where are you in that 
process and 
Ms. PLETNICK. So Arizona has submitted their plan, so it would 
be for that submission date of September 2017. We have not yet 
received feedback on the plan. 

Mr. ALLEN. You have not? Okay. Do you see as far as what you 
are trying to implement, is there any lack of interpretation of ex- 
actly what you think the law that we passed says versus what you 
are trying to accomplish? 

Ms. PLETNICK. I think the Arizona plan reflects the ESSA law 
and so we feel confident in our ability then to have that approved 
and move forward on the implementation. 

Mr. ALLEN. Okay. Ms. Wright, Dr. Wright, do you, I mean, do 
you feel like what you are trying to do reflects the law that we 
passed in every respect? 

Ms. WRIGHT. Absolutely. We have had no difficulty whatsoever 
with working within the guardrails that are provided and with as 
much input as we have had, as I said, we have had over 7,000 
pieces of feedback. I meet with the superintendents on a monthly 
basis, my advisory committee, my teacher advisory committee, the 
principal’s advisory committee, we are meeting with those folks on 
a regular basis to get their input. 

But when we come together then to start the formation of the 
plan, we have not had any difficulty whatsoever in abiding by the 
guardrails. 

Mr. ALLEN. Well, that is great to hear because it is really excit- 
ing to see the efforts that are being put forth by the States to make 
sure that every student succeeds. And I want to thank you and 
congratulate you on what you are doing and I yield back. 

Chairwoman Foxx. Thank you, Mr. Allen. 

Ms. Davis, you are recognized for 5 minutes. 

Ms. Davis. Thank you, Madam Chair, and thank you to all of you 
for being with us today. You know, one of the things that I have 
been thinking about sitting here that has not been addressed so 
much is just the capacity right now of the Department of Education 
to work with States, to work with districts in looking at all of these 
plans. 

And, you know, so I really inquired about the number of vacan- 
cies. And when you look at that, 12 out of 15 nominees have not 
even been put forward or 70 percent of senior staff is vacant. Just 
thinking about which ones those are, the deputy secretary, there 
has been no nominee put forward for the assistant secretary for 
civil rights. 

We have an acting person who has been quite under fire, as you 
probably know. There is no nominee for the assistant secretary for 
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elementary and secondary education, no nominee for the assistant 
secretary for planning, evaluation, and policy development. No 
nomination for the Assistant Secretary for Special Education and 
Rehabilitative Services. No nominee for the assistant secretary for 
career, technical, and adult education, and we have talked about 
that in the capacity of districts. 

Ms. Nowicki, as the GAO representative here, how does that ca- 
pacity affect the ability of States to move forward? 

Ms. NowIckI. Yes, ma’am. I think, you know, to the degree that 
there is no political leadership in place in any Federal agency, I 
think that does, you know, certainly play a role in the ability of the 
very talented and dedicated civil servants in any Federal agency. 
I think you are respectfully trying to not get out in front of, you 
know, where an administration may wish to go. 

Ms. Davis. Yeah, I think so because, as you said, they are dedi- 
cated, but when you are in limbo, when you are waiting for leader- 
ship and direction, that is a difficult thing to do. I don’t know, Mr. 
Lovell, do you want to comment on that as well? How much of a 
problem is it? Maybe it is not a problem. 

Mr. LOVELL. Sure. No, I think that is definitely a problem. When 
you combine lack of staff capacity with lack of clarity as a result 
of the rescission of the regulation, it really puts a lot of pressure 
on the career staff to go through these hundreds and hundreds of 
pages of material. It is complex. It is dense. I think that there are 
certainly areas that warrant clarification, such as when a State 
submits a plan and the question in the template requires a State 
to define the term “consistently underperforming students.” 

And then when a State responds by saying we will identify low- 
performing students, what does that mean? Without the regulation 
in place you don’t have a whole lot of guidance to determine what 
that means or what that doesn’t mean, if it is consistent with the 
law or if it is not. 

So the Department’s feedback basically now is serving as that 
guidance and States have to—are looking at that really closely to 
see, well, what rules do I have to follow? 

Ms. Davis. Sure, yeah. And I think you mentioned earlier that 
when it comes to some of those regulations, looking at whether ca- 
reer and tech, you mentioned that. We also talked earlier about the 
consistency about higher level thinking skills and where that is 
placed as well. In addition to that issue, of course, we have the 
budget issues that have been discussed. And I am wondering what 
the impact of deeper cuts to education will have on the ability of 
States to really serve our most vulnerable students. 

And one of those areas we have included a requirement in ESSA 
for 95 percent of all students in each subgroup to participate in an- 
nual assessment to ensure that low-performing students are not 
encouraged to be absent on test day. One particular example, and 
if we are disaggregating data, that is going to be a very important 
effort that moves forward for all students. 

How are States implementing this policy and how is the Depart- 
et, of Education going to oversee that given the situation they 

ave? 

Mr. LOVELL. So you have raised two issues, one around funding 
and one around the 95 percent test participation requirement, and 
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let me address those both. So on the funding I want to go back to 
actually a comment raised by Mr. Barletta. He asked about how 
States were being able to leverage title I and title IV dollars for 
afterschool programs. 

Specifically, with regard to title IV it is pretty hard to leverage 
something that doesn’t exist. Title IV has been so woefully under- 
funded that it is questionable how those dollars are going to be 
able to be used. Authorized level was $1.6 billion. Last year $400 
million was provided. That is less than a third of the authorized 
amount. So being able to use those dollars for things like after- 
school programs is a real problem. 

The 95 percent participation rate is also a real problem. One 
place where the Department has not been inconsistent is in consist- 
ently not mentioning the 95 percent test participation requirement. 
There are a number of States that either simply say we are not 
going to abide by this part of the law or have too little, very little 
of an explanation as to how they are going to, and mum has been 
the word on the 95 percent test participation requirement. 

Ms. Davis. Any other comments that you all would like to make 
to those questions? I know we don’t have any time left hardly. 

I think, you know, this is really an important hearing and I 
think when we look back a few years from now to sort of see how 
did it go, how was it implemented, I think what you have provided 
today, all of you, has been helpful. Thank you very much. 

Chairwoman Foxx. Thank you, Ms. Davis. 

Mr. Mitchell, you are recognized for 5 minutes. 

Mr. MITCHELL. Thank you, Madam Chair. Upon the passage of 
ESSA, the Wall Street Journal noted, and this is a quote that, “It 
represented the largest devolution of Federal control to the States 
in a quarter century.” Unfortunately, the previous administration 
apparently did not endorse that bipartisan bill. 

In fact, the previous chair and the chair in the Senate submitted 
a letter to the Secretary, 30 pages of concerns and objections to the 
proposed regulations that, frankly, were largely ignored. The mi- 
nority here wishes to relitigate the discussion regarding the CRA 
and the elimination of the rules that were put forth by the previous 
administration. 

Let me give you some areas of concerns. The 95 percent that you 
referenced, however, the final rule referenced only four options and 
requires schools to implement a plan to address those. There is a 
whole series of things the Department did that overreached the in- 
tent of this Congress or the previous Congress and this committee. 

I wasn’t here at the time, but, frankly, voted in favor of the CRA 
because I am offended by the fact that a bill is put forward by this 
House and Senate that the administration decided it didn’t meet 
their expectations to do as they wanted. That is not the way this 
government works. 

So rather than spend quality time, frankly, whining about the 
CRA, we ought to get on and talk about the effect of the address 
of the needs of students of education. 

Question for you, Dr. Wright, if you could, please? Could you de- 
scribe some of the means by which you attained what you consider 
to be quality stakeholder engagement? 
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Ms. WRIGHT. We scheduled meetings around the State and we 
scheduled them at two different times. We scheduled a total of 15 
initially, but that does not count all the other specific stakeholder 
groups that we met with. These were regional meetings. We sched- 
uled our first one typically in the afternoon, somewhere around 
3:00, so that those people that were available could be there. 

But we scheduled the second one in that same area typically 
starting at 6 or 6:30, so that we could ensure that our parents that 
were working would have an opportunity to get there after they got 
off work. So we made sure that we tried to cover all areas of the 
State and also in reaching out, our ESSA advisory group is one 
that has a diverse group of individuals on it. 

We met with them on a regular basis. As I have mentioned to 
you before, I have got a superintendents advisory committee that 
I meet with on a monthly basis. I meet with my teachers every 
other month. And so it gave us an opportunity to really hear from 
a lot of people. 

Mr. MITCHELL. Thank you. Dr. Pletnick, as well, most important 
stakeholders, we call them stakeholders here, they are parents. Let 
us be honest about it. What did you do to make sure that we got 
effective parental engagement in this process? They felt that they 
were heard? 

Ms. PLETNICK. In Arizona, there were a number of committees 
and subgroups that were established and they would have rep- 
resentatives from all stakeholders group. So certainly our parents 
are important, our business partners are important. All of those 
people were represented on the various committees. And in addi- 
tion, we did have a survey and anyone could provide feedback, for 
instance, on our measures of success, those indicators that we were 
including. 

There were also, again, meetings that were held across the State, 
a number of meetings, where people could come and engage, ask 
questions, get clarification, and provide feedback. 

Mr. MITCHELL. What percentage of your parents responded to the 
survey approximately? 

Ms. PLETNICK. I honestly do not have those numbers with me, 
but I know it was open and there was good participation in it. I 
do not have exact numbers. 

Mr. MITCHELL. Well, I am sure it is open. I wasn’t questioning 
that. My concern is that we do everything we can to maximize the 
engagement of parents in how this is structured and engage them 
in the educational process so they have every reason to participate 
with their children. So that is critical and I would ask, Ms. 
Nowicki, if we could make sure as we look at, I know you have 
nothing to do with the operation, but going forward in terms of the 
effectiveness, that we look at the effectiveness of engaging not only 
stakeholders, teacher groups, those types of things, but parents in 
the process prospectively and after it is underway. Can we assure 
that is going to happen? 

Ms. NOWICKI. We would be happy to work with the committee on 
any requests that they wish to submit having us look at stake- 
holder and parent involvement, absolutely. 
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Mr. MITCHELL. Madam Chair, I would ask that we at least con- 
sider that as we go forward in assessing the effectiveness of ESSA, 
that we ensure parental—look at the effectiveness of engagement. 

Chairwoman Foxx. Thank you, Mr. Mitchell. 

Mr. MITCHELL. Last question for you if we could, I guess is that 
it would be about the last stage of ESSA is identify and assist 
school districts that are low performers. Michigan has some leg- 
endary low-performing school districts, unfortunately. A variety of 
things have been done to try to address that. 

My question for you would be, also, Ms. Nowicki, is there a proc- 
ess by which you are going to assess the effectiveness? Have you 
identified, one, whether the plans are effective at addressing low- 
performing school districts? 

Ms. NOWICKI. Yes, sir. I think when we have an opportunity to 
see the monitoring protocols that the Department eventually devel- 
ops, that is one of the things that we would be interested in looking 
at how they are approaching that. 

Mr. MITCHELL. I would be curious if the other two educational 
witnesses, Dr. Pletnick and Dr. Wright, if we get any feedback just 
of how you are going to monitor that because it seems to be a 
plaguing problem in some States. Clearly it is in Michigan, and we 
need to not only talk about what we are—how we are assessing 
them, but how we are supporting them and are we getting im- 
provements or are we just spinning our wheels and students are 
being lost? 

Ms. WRIGHT. Well, actually, it is one of the goals in our strategic 
plan that all schools and all districts will be rated C or higher. And 
so our focus to do that, we have an A through F system, was to 
identify the lowest performing schools. We are going to be using 
subgroup data to do that. 

We have also got a protocol in place that we have required all 
of our low-performing schools to come in for a personal interview, 
which includes their board members, their principals, et cetera. 
And then go through the protocol with them about what we are 
going to be monitoring and how frequently. 

The bottom line for me as the State superintendent is, are stu- 
dent outcomes improving? 

Mr. MITCHELL. That is right. 

Ms. WRIGHT. And that is where we are coming from. 

Mr. MITCHELL. Thank you and I yield back. Thank you for your 
patience. 

Chairwoman Foxx. Thank you, Mr. Mitchell. 

Dr. Pletnick, if you could respond to Mr. Mitchell in writing, I 
would appreciate it. 

Mr. Grijalva, you are recognized for 5 minutes. 

Mr. GRIJALVA. Thank you, Madam Chair. Dr. Pletnick, welcome, 
and I am glad you are here. I want to talk—ask some questions 
about some mitigating factors in terms of how the State plan is ap- 
proved, when it is approved and the implementation of ESSA in 
Arizona in the public school districts. 

Mitigating plans points being, you know, Arizona, along with 
Mississippi, are at the five lowest States in terms of per people ex- 
penditures to the public schools; Arizona is about $3,300 under the 
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national average. So that lack of State support in terms of public 
instruction is a constant in Arizona. 

It has been litigated. It has been referendumed. It continues to 
happen yearly at the State level. But now let me ask, so that is 
a constant. And you couple that with the cuts that are being pro- 
posed in the education budget and that is an additional layer of 
lack of support upon the public schools in Arizona and across the 
country. 

But then you have also the threat of public funds going to pri- 
vate school vouchers, for-profit charter schools; they are very real 
now given President Trump and Secretary Devos’ singular focus on 
that concept. Under the repealed regulation charter schools are 
going to be held accountable through an authorizer’s reporting. 
Now, without that regulation that has been repealed, they will be 
even less accountable because of that. 

And the proliferation of for-profit charter schools in Arizona, 
charter schools in general, don’t you think that regulatory require- 
ment would help to improve the transparency of the State’s charter 
sector, Doctor? 

Ms. PLETNICK. So what I would say is I truly do believe in ac- 
countability. So I do believe if any school system receives Federal 
or State funding that they should be held to the same account- 
ability as every other because I think that is about transparency. 

Mr. GRIJALVA. And, you know, I also mentioned the Affordable 
Care Act, $26 million goes to the State of Arizona for Medicaid to 
work with children with disabilities. That is $26 million that if the 
repeal scenario is what we are talking about now, then that would 
be, again, another layer of nonsupport that would not be there par- 
ticularly for disabled kids. 

During the discussion, I am assuming that the discussion of a 
national voucher tax credit proposal, probably using a tax reform 
vehicle probably, that is modeled after State programs like the one 
we have in Arizona, do you feel that Arizona’s voucher program is 
indeed helping students? And would you recommend as a national 
policy, that we model a national policy after Arizona’s voucher pro- 
gram? 

Ms. PLETNICK. I am here at the invitation of Chairperson Foxx 
to speak on ESSA implementation. And so I am not as prepared 
for this hearing to speak to that. Certainly, I could provide addi- 
tional information regarding it, but there is certainly an impact 
when we have expansion of those programs. And we know that at 
the State level. 

Mr. GRIJALVA. And if it is public money that is being diverted to 
those programs, as a consequence it is less another layer of non- 
support from the public schools in Arizona. 

Ms. PLETNICK. There is an impact on it. 

Mr. GRIJALVA. So we have those mitigating factors. Where is the 
rte plan at this point? Waiting for review? What is the story on 
that’? 

Ms. PLETNICK. Yes. It was submitted so that it was submitted I 
believe in May, which would make it for that deadline in Sep- 
tember for review. 

Mr. GRIJALVA. And you heard the complaints, I am sure. Many 
parents, stakeholders, educational groups relative to the fact that 
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the access and the lack of real dialogue in terms of what that plan 
was going to be that was, I think, essentially run out of the gov- 
ernor’s office, that there was some opposition and discomfort with 
the way the plan was put together, correct? 

Ms. PLETNICK. So again, I think that there are components in the 
plan, as I had shared. I do not think that it is a perfect plan. So 
I believe there needs to be continued dialogue as we look at what 
we need to do to continue to drive improvement, especially for our 
underserved populations in Arizona. 

Mr. GRIJALVA. And thank you very much. I appreciate that. But 
without resources, asking public school systems to meet any bench- 
mark and we see eroding support at the State level, at the national 
level, and at all levels for our public schools, I think you are put- 
ting not only the school system in a bad place. You are putting par- 
ents in a bad place and you are jeopardizing a lot of children. And 
with that, I yield back. 

Chairwoman Foxx. Thank you, Mr. Grijalva. 

Mr. Smucker, you are recognized for 5 minutes. 

Mr. SMUCKER. Thank you, Madam Chairwoman. 

Dr. Wright, in your testimony you mention the opportunities to 
expand career and technical education to the classrooms of our ele- 
mentary and secondary students. And I know there has been some 
discussion about this. I apologize if it is a duplicate question. 

But, you know, it is a top priority of this committee and a top 
priority of mine as well. Pennsylvania is working on developing 
their own State plan in response to ESSA and just wonder what 
ideas you may have for Pennsylvania and other States to integrate 
career and technical education into those plans. 

Ms. WRIGHT. Well, that is one thing that we have been very 
proud of is working with our businesses around the State. We serve 
on the State’s Workforce Investment Board and I think having a 
seat at the table, I think, has a very powerful reality for us. We 
then separate the State into the local workforce boards and have 
been working directly with them. 

They have been very receptive to our work. We are intending to 
create, as I said earlier, those CTE plans in high school, but we are 
also looking to see how early we can start some of these plans in 
middle school because I think some of our children, we realize that 
not everybody wants to go to college. 

But everybody deserves the right to have a wonderful job as soon 
as they, you know, walk across our stage. And so our job is to en- 
sure that all of our children are career and college ready. We are 
also redoing our diploma options, to be honest with you. We have 
got one that is going to have a CTE endorsement and that is going 
to be a nationally recognized endorsement that children will be 
able to go right to work if that is what they so choose. 

But I think the key for us is the developing in our economy and 
that the way to do that is to ensure that we have got a strong 
workforce out there that can do that. And the children that are in 
our classrooms are the ones that are going—we are going to be de- 
pending on. So we have got to ensure that they have got the aca- 
demic skills to do that, but they also have to have the career and 
technical skills to do that as well. 
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of SMUCKER. You mentioned a national endorsement? What is 
that’? 

Ms. WRIGHT. Yeah. We are looking at the number of national en- 
dorsements that students can have, certifications that they can 
have. We have got a large number of different manufacturing com- 
panies. Toyota has a big presence. Nissan has a big presence. 
Ingalls Shipbuilding has a presence. The Stennis Space Center has 
a big presence. 

So we have got a huge medical area as well, as well as some of 
the smaller businesses that are looking for people to come to their 
employment. As I said earlier, about 65 percent of the jobs that are 
available are children that are going to need middle schools. 

Mr. SMUCKER. So that certification or endorsement would be part 
of their diploma as well? 

Ms. WRIGHT. Yes. 

Mr. SMUCKER. Okay. 

Ms. WRIGHT. Yes, sir. 

Mr. SMUCKER. Interesting idea. Next question. This would be for 
both Dr. Wright and Dr. Pletnick. Yesterday I had the honor of 
welcoming Chairwoman Foxx to my district and we had a round- 
table discussion with education leaders from across the district and 
industry stakeholders as well. And a topic came up that I have 
heard a lot about in the State senate in my State, and chair of the 
education committee. 

I am just curious what your States are doing in regards to stand- 
ardized testing. Superintendents who were there and who have 
heard from the past few years have felt that there has been sort 
of an undue or too much emphasis, I guess, on having all students 
achieve a certain standard as opposed to, I think today we have 
technology or we have education available to provide more individ- 
ualized learning to meet a student exactly where they are, and help 
all students achieve to their full potential. 

So I guess I am curious how both of your States are responding 
to that? 

Ms. WRIGHT. Well, in Mississippi, we have established and 
adopted a set of very rigorous standards pre-K through grade 12. 
And I think we owe it to our parents and our community to be very 
transparent about what our children should know and be able to 
do by the time they leave 12th grade. It is going to be they depend 
on us each and every day to ensure that their children are getting 
what they deserve. 

And so I feel very strongly that you have got to have a strong 
set of standards in place that are going to enable children to be 
successful when they leave us. And so that is how—that is the ap- 
proach that we have and that is the approach that we are sticking 
to. 

Mr. SMUCKER. Dr. Pletnick, could you respond? 

Ms. PLETNICK. So in Arizona, we do have what is called the Ari- 
zona Merit and that is aligned to our standards. Our standards, 
too, are very rigorous, but as a superintendent, I also believe that 
there are many other skills and dispositions that we have to ensure 
students have before they leave us if they are to be future ready. 

I think about the fact that I really didn’t have to think about 
coding when I was in elementary, yet that is a skill that is a fu- 
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ture-ready skill. When we talk about the four Cs, communication 
and critical thinking, all of those things, so I think there have to 
be multiple measures and that is what we have worked towards in 
Arizona in terms of our CC&R indicators. 

So one test can give us some feedback, but we need multiple indi- 
cators to get the true picture of student success and school success. 

Mr. SMUCKER. Thank you. 

Chairwoman Foxx. Thank you, Mr. Smucker. 

Ms. Blunt Rochester, you are recognized for 5 minutes. 

Ms. BLUNT ROCHESTER. Thank you, Madam Chairwoman and 
also Ranking Member Scott, and also thank you to the panel. I was 
really pleased to hear that our chairwoman has invited Secretary 
Devos to our committee. Education and ESSA implementation is 
probably one of the things that I have heard most from Dela- 
wareans, whether it is the champions in civil rights that I talk to, 
those people who are interested in lifting people out of poverty, to 
the corporations in my State which we have many, and all of the 
small businesses. 

This is probably one of the top issues. And so my question, I first 
want to start with Ms. Pletnick. You stated in your testimony that, 
“Consistency in how ESSA is interpreted and regulated is critical. 
Uncertainty created by shifting interpretations of the ESSA law 
continues to be a concern.” 

Given that there is currently no regulatory scheme for ESSA in- 
terpretation, what position do you think that this puts States in de- 
veloping and implementing their plans? 

Ms. PLETNICK. So I believe in whether we are talking at the Fed- 
eral level, we are talking at the State level, again, it is important 
to have that consistent feedback because then, in turn, we can 
move on with the implementation of ESSA, and make certain that 
we are directing all our efforts to that implementation, and check- 
ing those outcomes. 

So it is critical as we move forward that we make certain that 
we know exactly what our targets are, that we can get to work, and 
get the work done. So my concern is really about consistency across 
the board at all levels. 

Ms. BLUNT ROCHESTER. Across the board. I want to follow that 
up and, Mr. Lovell, if you could also join in. What impact would 
the lack of regulation have on underserved populations? 

Mr. LOVELL. That is a monumentally important question. The 
concern is that the lack of the regulation will result in too few chil- 
dren being identified and then receiving the support that they need 
to succeed. We want to make sure that States, when they are pro- 
posing to identify students for additional support, that while we 
want to use all the indicators in the system to support them, we 
don’t want them to make—we want to make sure that kids don’t 
have to fail on everything before they are actually identified. 

I think that is a major concern considering that a few States 
have been very clear that they want to look at are kids performing 
on grade level, and if they are not, then let us do something about 
that. The Department has pushed back on that a little bit and that 
is very unfortunate because, frankly, if students are not performing 
at grade level, or if they are not graduating, I don’t need to know 
much else to know that something needs to happen. 
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I need to know a lot more to know what to do about it, but I 
don’t need to know a lot more to know that there is a problem. And 
then back to your, again, question around the regulations. 

That, you know, the role of the regulation is to provide a lot of 
clarification and there was a comment earlier around the 95 per- 
cent requirement and whether the regulation is being overly pre- 
scriptive. Four options were presented. 

One of those options in the regulation around the 95 percent was 
essentially States choose your own adventure. Come up with your 
own option. So to say that it was only four options is actually not 
entirely the case. 

And as a result, we have States when it comes to how are they 
going to be implementing this very important provision of the law, 
either not being clear about it or not doing it at all. 

Ms. BLUNT ROCHESTER. You know, I really want to touch a little 
bit on both regulation and also on capacity. We were talking about 
undersecretaries and the positions not being filled. I had the oppor- 
tunity in Delaware to serve as a deputy secretary of health and so- 
cial services. 

And while I—I was also secretary of labor, and secretaries do 
have an important role. They are external. They are visionary and 
all of that. But a lot of the detail gets done at that undersecretary 
level. A lot of the administrative things, a lot of the—there is so 
much importance also to that level. 

And so my concern about filling positions is I share Ms. Davis’ 
concern. Also about regulations, I guess, having come from State 
government, I believe there is a place for regulations. Can we over- 
regulate things? Yes. But there is a real place and I think what we 
are hearing from all of your testimony across the board is consist- 
ency, clarity—that helps people to be able to do their jobs better. 
It helps us to be able to get better outcomes. 

So I have no more questions. I am just going to yield the balance 
of my time. 

Chairwoman Foxx. Thank you very much, Ms. Blunt Rochester. 

Mr. Grothman, you are recognized for 5 minutes. 

Mr. GROTHMAN. Thank you. I guess I will ask a question to ei- 
ther Dr. Pletnick or Dr. Wright, who is best able to answer it. 
Could you first of all just give us a general overview? I mean, we 
wanted to get around, we passed Student Success Act, get around 
this top-down approach to how you run your schools. Do you feel 
we have succeeded in that? Are you happy with that or would you 
like further things done alone those lines? We will start with Dr. 
Pletnick. 

Ms. PLETNICK. As I had shared earlier, I think there are still 
some things even at our State level that were legislation that was 
tied more closely to the No Child Left Behind era than to what cur- 
rently is in place with ESSA law. 

So I think there is still room for improvement and we need to 
work on that. Teacher evaluation is an example of that, some other 
pieces. So, yes, ESSA has provided us with some of that autonomy 
and flexibility, but at the State level, I think we still have some 
things that we will need to do. 

Mr. GROTHMAN. Okay. Are you satisfied with what you are get- 
ting out of Washington, though? 
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Ms. PLETNICK. Yes. Again, I will tell you that we have submitted 
our plan. We have not gotten any feedback on that plan at this 
point. 

Mr. GROTHMAN. Okay. Same question for you, Dr. Wright. 

Ms. WRIGHT. Yeah, I think the State’s role, at least in Mis- 
sissippi, is, you know, setting the long-term goals per subgroup 
area so that we know what we want for our children 10 years out. 
But I think it is really the local districts and the local schools that 
need to be developing their own respective plans on how they meet 
the needs of their individual children. 

I wouldn’t presume to know. I have got 144 districts, all the 
needs of that, so I trust my superintendents and the principals and 
the teachers of that school. 

Mr. GROTHMAN. You are satisfied with the Student Success Act, 
though? 

Ms. WRIGHT. Yes. 

Mr. GROTHMAN. And we say we were pushing things out. 

Ms. WRIGHT. Yes, I am, very much so. 

Mr. GROTHMAN. You were saying so. Okay. A little while ago, you 
kind of were talking very positively about kind of more preschool. 
Have you ever read anything indicating the preschool is not nec- 
essarily much of a benefit? 

Ms. WRIGHT. No, quite to the contrary. Preschool, there is too 
much research out there now for us to not be paying attention to 
our three- and four-year-olds. Quite honestly, we are going to be 
starting to look to how can we start helping children, you know, 
birth through grade three. I think that has been one of the things 
that we have been pushing out across our district is the amount 
of research that is being conducted recently and the long-term ef- 
fects, even in Mississippi, that we can verify by research that has 
been done by Mississippi State on Mississippi children. 

Mr. GROTHMAN. Okay. You have never read anything to the con- 
trary to that? Never read anything —— 

Ms. WRIGHT. Long time ago, but not within the past I would say 
5 years. Not to my knowledge. 

Mr. GROTHMAN. Okay. Next question. One of the metrics that is 
supposed to show a quality school—well, I will go to this one. What 
is an underserved population? Mr. Lovell just used that as a 
phrase, but could anybody describe what you consider an under- 
served population? 

Mr. LOVELL. Well, the law stipulates that States are supposed to 
disaggregate data for accountability and reporting purposes for 
major racial and ethnic groups, for English learners, for low-income 
students, and for students with disabilities. So those are the cat- 
egories of students that, generally speaking, when we speak to un- 
derserved populations that we are referring to. 

Mr. GROTHMAN. Does underserved mean lack of money? Does it 
just mean poor outcomes? Is 

Mr. LOVELL. Well, it also refers really to both when you look at 
schools that predominantly serve those populations of students spe- 
cifically —— 

Mr. GROTHMAN. Sometimes in Wisconsin, some of the most 
underperforming districts have the most money and that is why I 
wondered what you meant by underserved. 
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Mr. LOVELL. Well, so I think that we would present data that 
would suggest otherwise. 

Mr. GROTHMAN. Nationwide or 

Mr. LOVELL. Oh, sure, across the country. 

Mr. GROTHMAN. Okay. Okay. Final question. Sometimes one met- 
ric used to measure a quality school district is graduation rates. I 
know graduation rates are overall up. On the other hand, a lot of 
times you hear from employers today, people who teach in sec- 
ondary education that they feel the kids aren’t doing as well or as 
prepared as they used to be. Could you comment, say, Ms. Nowicki, 
on the contradiction there? Is it possible we are lowering the stand- 
ards on what it takes to graduate? Or how can graduation rates be 
up, but employers and people in secondary education sometimes 
feel the kids graduating aren’t doing as well? 

Ms. NOWICKI. GAO has not done any recent work around gradua- 
tion rates, so I can’t comment from that perspective. I know that 
the Department of Education’s IG has done some work looking at 
graduation rate statistics and what they mean and don’t mean in 
particular States. 

Mr. LOVELL. So our organization has looked at this, and actually, 
we are going to be releasing a report in the next few weeks because 
that contradiction definitely exists. And States in their ESSA plans 
have the opportunity to address this by including items in their ac- 
countability system that prioritize not just that you get a diploma, 
but that you get a diploma that really represents that you know 
something. 

And to your questions earlier around early childhood, while I 
haven’t seen anything that shows that early childhood is ineffective 
or isn’t necessary, I have read research that shows that early child- 
hood on its own is insufficient. 

So in other words, you can’t—early childhood is not an inocula- 
tion. You have to continue to invest and support kids throughout 
their development. 

Mr. GROTHMAN. Yeah, I would hope Dr. Wright would Google 
early childhood education and criticism and she will have no prob- 
lem finding other things. Thanks much. 

Chairwoman Foxx. Thank you, Mr. Grothman. 

Dr. Adams, you are recognized for 5 minutes. 

Ms. ADAMS. Thank you, Chairwoman Foxx and Ranking Member 
Scott, for convening this hearing, and thank you to those of you 
who testified today. I want to reemphasize one of the main points 
that Mr. Lovell mentioned in his testimony that ESSA is, at heart, 
a civil rights law. 

The Federal Government has an important role to play in ensur- 
ing equity in education for our children. And while States have 
wide discretion and flexibility to determine how success is meas- 
ured, the Federal Government sets the standard for success. 

So it is especially true in historically underprivileged groups. So 
Mr. Lovell, States have the discretion to create and define the met- 
ric used for consistent underperformers. In your analysis of State 
ESSA plans, how are States defining consistently underperforming, 
and do you think this equity guardrail in the law is being executed 
as intended to ensure schools struggling to meet the needs of un- 
derserved students are identified and supported to improve? 


79 


Mr. LOVELL. Thanks very much for your question. I think this is 
one of the most important provisions in the law. If we are not iden- 
tifying kids who are continually underperforming, then what are 
we here for? And if we are not supporting them, then we are cer- 
tainly not doing our jobs. 

A number of States have proposed ways to do this that ensure 
that if you are—if a student is not performing at grade level in 
math or reading, or if there are low graduation rates, those chil- 
dren are identified and something will happen as a result of it. 
They will receive some sort of support. 

Unfortunately, a number of States are also putting together 
these sort of indexes where you are including a whole bunch of dif- 
ferent factors to determine whether a kid is low performing or not. 
And what we are concerned about is that if you are performing well 
in one area, that might mask if you are performing less well in an- 
other area. 

And so when you combine all these things together, you come up 
with not a whole lot that is actually usable. So we want to be sure 
that States have the flexibility to, as I believe it is being proposed 
in Mississippi, to look at if you are performing at grade level in 
math or reading. If you are not, then you should be able to receive 
targeted support. 

You don’t have to—you need to look at each indicator in the sys- 
tem, but you don’t have to fail on all of them in order to receive 
support. 

Ms. ADAMS. Thank you. 

Dr. Wright, you mentioned in your testimony that Mississippi is 
including students’ subgroup performance in identifying schools for 
support and improvement. And I know that your plan is only in 
draft form, but how is Mississippi planning to measure subgroup 
performance and factor subgroup performance into the school’s rat- 
ing? 

Ms. WRIGHT. So we have the data that we collect on our state- 
wide assessment that we have just redone grades three through 
eight and then, once again, in high school. Those data will be 
disaggregated by subgroup and then monitored at not only at the 
State level, but at the district level and at the school level. 

So we will be able to track that data over time to determine 
whether or not those subgroups of children are continuing to 
underperform or are making progress. 

Ms. ADAMS. Okay, thank you very much. 

Madam Chair, I yield back. 

Chairwoman Foxx. Thank you. 

Mr. Garrett, you are recognized for 5 minutes. 

Mr. GARRETT. Thank you, Madam Chair. 

A wiser man than me said, probably 35 years ago, the nine most 
frightening words in the English language are, “I am from the gov- 
ernment and I am here to help.” I might amend that to 10 words 
and submit that I am from the Federal Government and I am here 
to help, pretty frightening in their own right. 

ESEA is a 50-year-old precursor to ESSA and arose during the 
Johnson administration along with the war on poverty. And we 
have seen as Federal dollars spent on local education rose, a re- 
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verse correlation in the performance of United States students 
versus students across the globe. 

And candidly, from a State where we rank anywhere between 
fourth and sixth as it relates to educational outcomes of the 50 
States on a regular basis, I wonder why we are competing against 
49 other States as opposed to a world of other nations. Because 
that is the playing field upon which our children will ultimately 
compete. 

It is often said that the road to hell is paved with good intentions 
and I have seen all too often people attack aspirants to serve in po- 
litical capacities based on what program they supported or didn’t 
support. If you don’t support this, you don’t care, or if you don’t 
support this, you don’t like children. If you don’t support this, you 
are not interested in finding solutions to poverty and expanding op- 
portunity. It is all horse feathers. 

What we need to be focused on as opposed to intentions is out- 
comes, results, what happens. And I will tell you speaking with 
frustration that vents back to 6, 7 years ago, as I was serving in 
the State legislature, where we identify failing schools and leave 
students in these failing schools without an option for the parents 
who lack the socioeconomic and financial wherewithal to vote with 
their feet, we doom those children to inferior outcomes and inferior 
educational opportunity. 

If you ask me whether I believe in nature or nurture, I will tell 
you I believe in nurture every single time and that the color of a 
young person’s skin or the job of their parents isn’t so much a pre- 
cursor on their success as to what they are exposed to. But we run 
into the institutional educational monopoly all the time as we try 
to create escape hatches for students in places, like the five, whop- 
ping five, schools that we had the courage to identify as failing in 
Virginia, to find a way out for these young people who have just 
as much fundamental entitlement to the single birthright of 
Americanship, and that is opportunity as every other kid. 

I am sick of watching kids fail based on their ZIP Code. But Jef- 
ferson said wisely, and I will paraphrase, the government closest 
to home is most effective, most accountable, and governs best. 

My colleague from Oregon states that she thinks the solution to 
our educational problems has to be at the Federal level. And then 
in the same paragraph lamented that ESSA prevented Oregon 
from including particular standards that she felt might help best 
effect good outcomes for students in Oregon. Dr. Pletnick, do smart 
people work with you? 

Ms. PLETNICK. I have very intelligent people working with me. 
Mr. GARRETT. And they are professional and trained people? 

Ms. PLETNICK. Yes, they are. 

Mr. GARRETT. And they care, they care about the children and 
the district that you serve? 

Ms. PLETNICK. They do. 

Mr. GARRETT. And you are the superintendent, correct? 

Ms. PLETNICK. I am. 

Mr. GARRETT. How many students does your district have? 

Ms. PLETNICK. Approximately 25,000. 
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Mr. GARRETT. And can you name one or two of those kids who 
might have special needs who you are trying to overcome the chal- 
lenges yourself? 

Ms. PLETNICK. I could, but I will not confirm —— 

Mr. GARRETT. I am not asking you to, but you could. Yeah, right, 
but nobody in this room could, right? You could and you care, and 
you have smart people, and we don’t have a monopoly on good 
ideas. And you want what? What is best for the outcomes for the 
students that you serve, is that correct? 

Ms. PLETNICK. Absolutely. 

Mr. GARRETT. Okay. Ms. Nowicki, you are familiar with the 
United States student ranks versus their global peers as it relates 
to academic performance in ratings like math and science? Are you 
familiar with the historical data? 

Ms. NowIckt. Not specifically. 

Mr. GARRETT. Okay. Are you familiar with how we were doing 
say in 1950, 1960, 1970 versus 1990, 2000, 2010 versus our global 
peers? 

Ms. NowIckI. Are you talking about the PISA ratings? 

Mr. GARRETT. And surveys of outcomes educationally. I would 
submit by way of brevity, because I have a minute and 9 seconds, 
that as we have spent more, we have actually gone down versus 
the competition. Now, I am not arguing against spending more. Let 
me be clear. We need to spend money on education. But I got an 
idea that folks in a county in Arizona and the State of Mississippi 
know better what is needed. 

Dr. Wright, we talked about CTE. Is it good in CTE to align the 
training that we give students with the needs of the job providers 
in the communities? 

Ms. WRIGHT. Absolutely. 

Mr. GARRETT. Okay. And who knows better the needs of the job 
providers in Tupelo or Biloxi, the people in Tupelo or Biloxi, the 
people in Jackson, or the people in Washington, D.C.? 

Ms. WRIGHT. The people in Tupelo and Biloxi. 

Mr. GARRETT. Correct, thank you. I mean, I just am a little bi- 
ased here. And so I guess what I am driving at here is that this 
is great and I think ESSA is a step in the right direction. It doesn’t 
have—like anything from Washington, it has warts and pimples, 
but you are good, smart people who give a damn, pardon me, about 
the outcomes for the children in your communities. And the way 
we arrive at the best solutions is by letting loose 50 laboratories 
for democracy and finding out what works. And our role, since we 
have already co-opted so much of the resources at the Federal level, 
should be to power those down to States and localities, would you 
agree, to let you all do what you think works best, and then let oth- 
ers fall in on the plans that succeed? Thank you. That is rhetorical. 
I am out of time. 

Chairwoman Foxx. The gentleman’s time has expired. 

Mr. GARRETT. Hey, I was only 12 seconds over, Madam Chair. 
That is a new record. 

Chairwoman Foxx. Mr. DeSaulnier, you are recognized for 5 
minutes. 

Mr. DESAULNIER. Thank you. Thank you, Madam Chair. Thank 
you for having this hearing. 
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And, Mr. Lovell, I am always taken when I look at the achieve- 
ment gap by a comment I heard by a Stanford researcher, Linda 
Darling, some years—well, it wasn’t that long ago, a few years ago, 
that if we had just continued to do what we knew is the right 
things to invest in 30 years ago for the past 30 years, we wouldn’t 
have an achievement gap. 

So when we look at the difficulties in people, whether they are 
in Mississippi or in Concord, California, where I am from, in 
achievement gap, could you talk to that a little bit about where ac- 
countability comes? That, yes, we want local jurisdictions to decide, 
but, on the other hand, there is a benefit to this research that ap- 
plies across all 50 counties and the Federal Government affording 
that to local communities so they can be informed on what is hap- 
pening around the country. And why it is important for consistency 
that there is some accountability there . 

Mr. LOVELL. Thank you very much for the question. I actually 
think that Chairwoman Foxx said it very well at the beginning of 
this hearing when saying that ESSA provides a balance between 
accountability and autonomy. And the reality is that everyone 
needs to have a role in this and there is a Federal role to be 
played. So ESSA is a civil rights law and what ESSA does is pro- 
vide a broad framework for the accountability and ensures that 
those kids who have the least have a shot of success. 

So it also needs, I think, to be well understood that we have seen 
improvements in educational outcomes over the last decade. Look 
at the graduation rates as an example. Back in 2000, 2001, if you 
were going to draw a line between the graduation rate in 2000 and 
2007/8, basically you have got a straight line. 

But then in 2008, something happened. The U.S. Department of 
Education under President George W. Bush issued a regulation 
around graduation rate accountability because apples were not 
being compared to apples across States if you compared graduation 
rate calculations. One State was using one calculation, another 
State was using another. 

After the Federal Government issued the regulation in 2008, you 
saw something pretty remarkable happen. Graduation rates start- 
ed increasing. As a result, since 2000, 2.8 million more kids have 
graduated. That is a big deal. It is a big deal for them and it is 
a big deal for the Nation’s economy considering that by 2020, two- 
thirds of jobs are going to require at least some postsecondary edu- 
cation and a high school diploma is the first step to getting there. 

Mr. DESAULNIER. And the second part of my questions are com- 
ing from the Bay Area and I appreciate the fact that we had really 
robust field hearings that the chairwoman and the ranking mem- 
ber were part of, and I was lucky enough to be part of those. But 
particularly, as you will remember, Madam Chair, the last part of 
that field hearing at Stanford University, the Harvard of the West 
Coast, I might add, to the Ranking Member, I get this all the time 
in the Bay Area, is from tech people. 

We have our challenges on housing and transportation. But the 
thing that comes up all the time from employers is we need to pro- 
vide a workforce for global economy that is changing at warp 
speed. So accountability is a big part in the business sector. And 
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again, a lot of these companies will move. I don’t want them to 
move from the Bay Area, but they are. 

But one of the things that determines where they are moving are 
things like housing costs, but it is also the education system. So 
while it is important, I think, and I very much support local control 
and what Dr. Wright, you have said, there are things that in this 
economy require, I think, the Federal Government and the busi- 
ness community to inform us at a local level this is what we are 
looking for, and this is what we have to invest in. So I will let any 
of you respond to that. 

And I think the urgency to that is really the predominant thing 
for me is how do we maintain our preeminence in innovation in 
this country and I'll say specifically for Northern California? The 
answer to that is investing in not just in education, but doing it 
smartly, but doing it in a way that is informed given how quickly 
the workforce is changing and the demands on that workforce. 

So Mr. Lovell, if you could start any of the other 

Mr. LOVELL. No, I would be happy to. You know, ESSA asserts 
that when there is low-performing schools or low-performing stu- 
dents something has to happen. It doesn’t prescribe what happens 
and there is the balance. The Federal Government ensures that we 
are taking care of our lowest-performing kids and leaves it to 
States and to districts and to schools and to my colleagues to my 
right and my left as to how to do that best. Because the Federal 
Government can’t do that, but what the Federal Government can 
do is ensure that we are all playing by the same rules. And I also 
say that we see a lot of really effective innovation taking place at 
oe ae level and pick on California in a positive way in this re- 
gard. 

CTE has come up on a number of occasions. And in California, 
through the Linked Learning Initiative there is a lot of really great 
work going on to integrate rigorous academics with CTE. And there 
is an important Federal role to play and this committee has played 
that role by reauthorizing the Carl Perkins Career and Technical 
Education Act. So there is a role for everyone to play, but I appre- 
ciate you raising this need to really acknowledge that the Federal 
role here is important. 

It doesn’t displace the local role, but it is two different roles. One 
is to ensure that our lowest-performing kids are being supported 
when they need it, and then the State and local role is to actually 
implement that. 

Mr. DESAULNIER. Thank you, Mr. Lovell. 

Thank you, Madam Chair. 

Chairwoman Foxx. Thank you, Mr. DeSaulnier. 

Mr. Scott, you are recognized for 5 minutes. 

Mr. Scott. Thank you, Madam Chair. 

Ms. Nowicki, did the GAO conduct a compliance review on plan 
components or policy decisions made by States, like Ohio or Cali- 
fornia, or did GAO make any value judgments concerning the plan 
development or did you just make an observation of those plans? 

Ms. NOWICKI. It was just an observation of those plans, sir. We 
did not make a compliance judgment. 

Mr. Scott. Thank you. And we heard complaints from some rep- 
resentatives of civil rights groups that flexibility could result in an 
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abuse of, really, equity compliance. Your plan didn’t comment on 
equity as I understand it. Did you contact representatives of par- 
ents, State-level advocates, advocates of children with disabilities, 
or civil rights groups? 

Ms. NOWICKI. Generally not for this work, sir. We were primarily 
ae ee with national stakeholder groups who were working with 

tates. 

Mr. Scott. Thank you. 

Mr. Lovell, the whole point of ESEA and ESSA is to eliminate 
achievement gaps providing equal educational opportunities. Can 
you, you have kind of gone around this, but can you show how sub- 
groups so far have addressed equity? 

Mr. LOVELL. How States have addressed equity? 

Mr. Scott. Yeah, within terms of —— 

Mr. LOVELL. The separate accountability? Thank you for the 
question. So there is a spectrum, right? So you have got some 
States that, as I have said, are looking at are students performing 
at grade level? And if they are, let us do something about it. You 
have some States that will be looking at a whole bunch of different 
indicators. And as I have said, I fear that in doing that, what we 
will be doing is providing the chance for low achievement to be 
masked by higher achievement. 

So if you say—so actually to the conversation that was taking 
place earlier around graduation rates, you can have a high gradua- 
tion rate, which means that kids are actually getting a diploma, 
but they may not be reading or doing math at grade level. Right? 
If you combine those two things together, then you are not getting 
the right read on what is happening in the school. 

Another thing that I fear is happening with regard to the role 
of subgroups in these plans is that when States have report cards, 
so if your school gets an A, B, C, D, F, they are not adequately in- 
corporating the performance of each group within their grades. So 
you can have a high letter grade, but you can have low perform- 
ance for historically underserved kids. 

Mr. Scott. And if you have a subgroup that is not doing well in 
the school system, what support do members of those subgroups 
get in schools that are otherwise doing well? 

Mr. LOVELL. Well, it is really up to the States, the districts, and 
the schools to determine that. The law stipulates that they are to 
receive evidence-based intervention, but the schools, the districts, 
and the States will determine what those interventions are. 

Mr. Scott. And, well, how is that a credible plan? Who decides 
whether there is a credible strategy to address achievement gaps? 

Mr. LOVELL. Well, that is a great question. The template that’s 
distributed by the Department of Education and the questions 
around school improvement, there really aren’t a lot of questions. 
And so what is really going to be happening is fairly unclear. 

Mr. Scott. Why is the 95 percent testing rule important? 

Mr. LOVELL. For a few reasons. One, we have to have accurate 
data. And two, we want to make sure that low-performing kids are 
not intentionally or unintentionally encouraged to not be present 
on test day. 

Mr. Scott. And what happens if you don’t get 95 percent tested? 
What happens to the data? 
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Mr. LOVELL. The data becomes unreliable. 

Mr. Scott. And, Dr. Wright, you indicated that your credentials 
are nationally recognized. What happened, what is wrong with cre- 
dentials that are not nationally recognized? 

Ms. WRIGHT. There may be some CTE. I assume you are refer- 
ring to the CTE programs. I think some of our local businesses, 
those CTE programs are going to be developed specifically for 
them, so they may not be a national credential. Having the CTE 
endorsement on the diploma is a student’s option. And so they can 
either go for the traditional diploma or to go for a CTE endorse- 
ment on their diploma. That is their option, but the local busi- 
nesses may not have a national certification. But they will have a 
certification that will allow them to assume a job in the local busi- 
ness. 

Mr. Scott. But what is the value of the national certification? 

Ms. WRIGHT. They can go anywhere in the United States. I 
mean, I think that is the power of having national certification is 
that children are mobile and families are mobile. So this will allow 
them to really look around the Nation to see where their certifi- 
cation could earn them, say, the most money or where their family 
wants to move to. 

Mr. LOVELL. And if I could run an example of this really quickly? 
There is the National Academy Foundation. Students that partici- 
pate in a NAF academy and they get the NAF track certification, 
they are graduating from high school with their diploma. They get 
the NAF track certification and 13 companies, and big companies 
like AT&T, Cisco, JP Morgan Chase, give those students pref- 
erential hiring treatment when they are done with postsecondary 
education. 

So there are ways that we can really incentivize integration of 
CTE in academics and make sure that when kids are graduating, 
they are graduating with something that will help them down the 
road. 

Mr. Scott. Thank you, Madam Chair. 

Chairwoman Foxx. Thank you very much, Mr. Scott. 

It is now my turn to ask questions of the panels. Dr. Wright, you 
talk about how Mississippi’s State plan is related to the State 
board’s strategic plan in Mississippi. 

Ms. WRIGHT. Yes, ma’am. 

Chairwoman Foxx. And we hope that ESSA allows you the flexi- 
bility to integrate the plan you are developing under ESSA with 
the work the State is already doing. Do you and your department, 
the State board, and other stakeholders around the State see that 
integration as possible and desirable? Or is your ESSA work some- 
thing that is happening separate from the other reform work going 
on in the State? 

Ms. WRIGHT. That is a great question. And we look at it as very 
much integrated. We feel very strongly that our State’s strategic 
plan is a strong one and we looked at ESSA as a way to strengthen 
that plan and refine that plan, and give us the opportunity to add 
other components that we may not have had in that. But that has 
been our message right from the very beginning. 

Chairwoman Foxx. Dr. Pletnick, could you respond to that same 
question in terms of what is happening in Arizona? 
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Ms. PLETNICK. As a matter of fact, there was an effort, again, to 
establish goals at our State level. And I had the privilege of serving 
on the long-term goal committee that established the goals as part 
of ESSA. And we were certain to align those goals to make certain 
that what the State had developed was also reflected in the State 
plan when the State forward—when the agency submitted those. 

Chairwoman Foxx. Great, thank you. 

Dr. Wright, we have heard criticisms which continue throughout 
the process for what became ESSA that States can’t be trusted to 
hold schools accountable and intervene in low-performing schools. 
And certainly Mr. Garrett touched on this in his comments. You 
talked about school improvement being an important element in 
the plan that Mississippi is developing. Obviously, this is some- 
thing that States and districts must do and should do. 

But ESSA largely puts the actual strategies back in your hands. 
Could you tell us more about how your State and school districts 
are thinking about improving low-performing schools under ESSA? 

Ms. WRIGHT. Absolutely. As I mentioned earlier that is our goal 
6 of our strategic plan around ensuring that our districts and our 
schools are rated C or higher. I feel very strongly that everybody 
needs to be held accountable and that starts with me, my team, 
and I think we owe it to our parents to ensure that we are looking 
out for all children across the State regardless of ZIP Code, as 
someone mentioned earlier. 

We are putting together protocols for our low-performing schools 
to follow. And as I mentioned earlier, we have even got a totally 
different process that we are using about having them coming in 
and justify even their spending. And to ensure that they do have 
evidence-based interventions that they are spending their money 
on and not just interventions that do not have any evidence of 
working. And so that is going to be something that we are doing 
on an ongoing basis. 

I feel very strongly that the children of our State deserve nothing 
less than the best and we have to ensure, as a State, that we are 
monitoring that very closely because not only our children depend 
on it, but our parents depend on it, and they trust us to make sure 
that happens. 

Chairwoman Foxx. Thank you. Another question, Dr. Wright. 

Ms. WRIGHT. Sure. 

Chairwoman Foxx. Dr. Pletnick has talked about how she ap- 
plauds the planning approach in Arizona even though she doesn’t 
agree with everything in the plan. And you have talked about the 
stakeholders you have engaged with and how your State plan re- 
flects the view of these stakeholders. And by the way, it is an im- 
pressive process that you have talked about. 

I am sure that not every stakeholder, though, agrees with every- 
thing that is in the draft plan so far. So how have you engaged 
with critics to at least ensure everyone has the opportunity to be 
heard? 

Ms. WRIGHT. I think it is really important that everybody’s voice 
is heard. I am a big believer in advocacy and I think that anybody 
that is in front of you that is advocating or advocating for a reason, 
and we have been very forthright about what we can and cannot 
do. 
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We went through a series of three different assessments in three 
different years. And that kind of drove my teachers and super- 
intendents a little crazy. So I said we are going to hold tight on 
an accountability system at least for three straight years under the 
same assessment so that they did not feel I was continuing to 
change the target. 

So when we have got stakeholders coming in and saying, well, 
we would love to have a school climate survey embedded into our 
accountability system, I have said if you can just press pause, we 
are putting a taskforce together now at the end of our third year 
to take a look at our entire accountability system and say are there 
any unintended consequences or are there other things we can add. 

So we have acknowledged what they have wanted, but we have 
also tried to provide a reason why we either can or cannot include 
that in our plan. 

Chairwoman Foxx. Great. Thank you very much for that. I want 
to thank all of our witnesses for taking time to testify before the 
committee today and even though most of our members have left, 
I really appreciate members on both sides coming and asking good 
questions, sometimes pontificating, but participating in what is 
going on as everybody has indicated, we have an important subject 

ere. 

I would now like to recognize Ranking Member Scott for his clos- 
ing remarks. 

Mr. Scott. Thank you, Madam Chair. Madam Chair, we have 
heard the necessity to get the Department of Education before us 
to respond to some of the concerns about inconsistencies in terms 
of responding to the State plans and other priorities by the Depart- 
ment, particularly in terms of the funding priorities. 

We have heard the real necessity for having many of the pro- 
grams within ESSA actually funded because if we are asking them 
to get the job done, we have identified technical assistance to 
teachers, afterschool programs, and other things that can be very 
helpful. And if we don’t fund them, it just complicates their life. 

The Elementary and Secondary Education Act passed in 1965 
was designed as a civil rights law to guarantee equal educational 
opportunities. We have gone through many iterations. The last, of 
course, is ESSA. It has two major requirements. One is a require- 
ment that localities assess to ascertain whether or not there are 
achievement gaps and where they find achievement gaps, having 
a meaningful strategy to eliminate those. 

Dr. Wright has indicated what a meaningful strategy may look 
like and I think it is significant that it wasn’t just one program and 
reaction. It is a long-term strategy that starts with early childhood 
education and following the students to ascertain whether or not 
the strategy is working and making sure that you actually address 
the achievement gap. 

There is flexibility in how to assess and in the strategy to elimi- 
nate the achievement gaps, but there is no real flexibility on the 
requirement that the assessment be done and that the account- 
ability, doing something about it, is credible. And if a State fails 
to adequately explain how they are going to assess for achievement 
gaps or fails to outline a credible strategy to address those achieve- 
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ment gaps, it is the responsibility of the Department of Education 
to intervene. 

Madam Chair, we have letters from several organizations that I 
would like to submit for the record. They are letters from advocacy 
organizations and stakeholders about their engagement in ESSA 
approval so far. The letters are from the Advocacy Institute, the 
Council of Parent Attorneys and Advocates, NAACP Legal Defense 
and Education Fund, and the National Down Syndrome Congress. 

Chairwoman Foxx. Without objection. 

Mr. Scott. I yield back. 

Chairwoman Foxx. Thank you very much, Mr. Scott. 

I have found this to be very, very interesting hearing today. And 
I think that a lot of what it boils down to is a subject we deal with 
a lot in this committee and that I talk about a fair amount, and 
that is the role of the Federal Government in education. 

I think it was very important that both Dr. Wright, Dr. Pletnick 
brought up the fact that ESSA is not your entire educational pro- 
gram in your States. I think that many times people tend to think 
that what the Federal Government is providing in terms of funding 
or what we are providing in terms of law is it, that is all you are 
doing. 

And I think we have done a disservice in many cases to the 
American people in many things that the Federal Government has 
done to make it appear as though the Federal Government is the 
savior. We have a big program and all of a sudden everybody 
thinks it is the answer. 

I think my own experiences as a member of a board of education 
tell me a lot about what Mr. Garrett was talking about. My experi- 
ences since then in visiting schools all over the country, we have 
a lot of wonderful teachers, principals, superintendents, custodians 
who want to provide a great educational experience for the stu- 
dents in their schools. 

And I think in many cases the Federal Government has a very 
limited role in that and that for us to always look to the Federal 
Government to solve every problem that exists out there is a mis- 
take. And we have to understand the limitations, I think, that we 
have. 

I think ESSA was a big step forward in giving the flexibility that 
the locals and the States need to be able to provide that education. 
My colleague said what we should be about is providing equal edu- 
cational opportunities and I certainly believe that. 

I believe that education is the answer to so many things that so 
many challenges facing people in this country from getting out of 
poverty, to finding meaningful work, to having a successful life. So 
I want those opportunities. 

But I think too many times what we say to the American people 
is that we can have equality in outcomes. And having taught for 
15 years I know that just isn’t going to happen. 

I was shocked. When I taught I said to my students everybody 
in here can make an A and I really meant that. And I gave unlim- 
ited opportunities to students to do that. But I had a Bell-shaped 
curve every semester and I was truly shocked by that because I 
didn’t believe—I thought everybody would take every opportunity 
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to make the best grade that he or she could make and it didn’t 
happen. 

So I believe in equal educational opportunities, but I don’t think 
we are going to have equal results. And I think we have to temper 
what we do, but we have to trust people at the local level. And I 
appreciate very much those people who are out there every day 
teaching, committing themselves to helping students. And for those 
of you who are administrators, bless you for what you do. Particu- 
larly bless you if you listen to your teachers, you listen to your par- 
ents, and you listen to the stakeholders. 

The other thing that we hear a lot about, and I am really glad 
Mr. DeSaulnier brought this up because it is true again on both 
sides of the aisle, in most cases we think of education as prepara- 
tion for the workforce. We don’t have many people who can go 
through an educational system and then not do anything to provide 
for themselves. And we are all hearing about this. And so I think 
emphasis on what we are doing out there, whether people end at 
the secondary level and don’t go on for any other formal education, 
they are going to get educated whether it is a formal process is 
really important. 

But I think we are moving in the right direction with ESSA and 
I am, again, particularly glad to hear our two administrative people 
talk about how this is one piece of the answer, not all of it because 
I think we have to understand the proper role of the Federal Gov- 
ernment. 

So thank you all very much. There being no further business, the 
committee stands adjourned. 

[Additional submission by Mr. Lovell follows:] 


s 
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School Improvement Under the Every Student Succeeds Aci 


The Every Student Succeeds Act of 2015 (ESSA) gives states and districts much more 


flexibility in determining how to turn around their lowest-achieving schools. ESSA 


stipulates that states must identify schools for improvement based on the performance 


of all sludents and student subgroups. However, the U.S. Department of Education (ED) 


no longer may specify particular school intervention models, as it did under ESSA’s 


predecessor, the No Child Leff Behind Act (NCLB). Moreover, funds previously set aside for 


School Improvement Grants (SIGs), a federal program that provided states with funds to 


support persistently low-achleving schools, now flow through the regular Tille | formula! 


For state and district leaders faced with the challenges of low- 
performing schools, not much has changed. It is not as if a new 
intervention strategy now has become available for district and 
state use, Once states identify the bottom-performing § percent 
of Tille | schools. high schools with a graduation rate at or beiow 
67 percent, and those schools with continually underperforming 
subgroups of students, as stipulated in ESSA, leaders of schools, 
districts, and states must act. In the case of the bo#tom 5 
percent of schools and high schools with low graduation rates, 
districts must lead “comprehensive” interventions. In the case 
of underperformance of student subgroups, schools mus! lead 
“targeted” interventions. in both cases, the intervening agent 
must adopt one or more “evidence-based” strategies, where 
evidence is defined as a practice supported by the findings of 
‘one of three categories of research: randomized control trials 
{known as Tier } research), quasi-experimental (Tier 2 research), 
or correlational (Tier 3 research}? 


ESSA also outlines a broad process for intervening in schools with 
underperforming student subgroups that references "targeted 
support and improvement plans," referred to throughout this 
report as “school improvement plans"? 


+ Schools, in partnership with stakeholders, musf develop and 
implement an improvement plan for each underperforming 
student subgroup. This plan must be informed by all data 
indicators and include’ evidence-based interventions.* 


The pian must be approved and monitored by the local 
education agency (LEA}. 


The improvement plan also must identify resource inequities 
for student subgroups performing ai the same level as the 
jowest-performing 5 percent of schools. 


if the siudent subgroup fails to improve within a state- 
determined number of years, the state steps in with 
additional action. 


ab ‘ : : 
American Education images of Teachers and Students in Action 
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Essentially, ESSA envisions torgeted intervention to be ihe 
purview of schools and districts. Under the law, states outline 

the parameters used fo identify schools with consistently 
underperforming student subgroups and identify schoois for 
intervention, Bul schools, in partnership with stakeholders. 
develop the improvement pions that districts must approve. 
Districts can apply fo the state for funding to support schooHevel 


intervention. 


There ore several key elements of this process for identi 


ang 

and intervening in schools that likely are required to raise the 
performance of underachieving student sudgroups. This report 
explores those steps, starting with a discussion of effective school 
needs assessments and school improvement plans {SIPs}. The 
appendix offers examples of evidence-based interventions for 
historically underserved students. 


School Needs Assessments 


Just as a doctor's prescribed course of treatment fails if the 
patient's condition has been diagnosed incorrectly, a school 
intervention will fail if it addresses the wrong problem. The 

school needs assessment is the diagnosis, and the SIP sets out 
the treatment. ESSA requires that the "thermometer" used to 
identify a low-performing student? subgroup includes indicators 
of student academic proficiency and growth or another 
academic indicator {for elementary and middle schools}, high 
school graduation rates {for high schools}. and English tanguage 
proficiency, together with at least one state-selected indicator of 
school quality or student success, For instance, data that shows 
poor performance in a student subgroup's math scores does not 
alone identify the cause for those tow scores, which could range 
from poor instruction, poor curiculum, chranic absenteeism, 
poor morale in the school with attendant discipline issues, wrong 
professional developmeni, lack of timely and disaggregated 
data, and more. 


ED's nonregulatory guidance makes the essential fink between 
ihe needs assessment and the schoolwide improvement 
program explicit: 


Comprehensive improvement plans must be based on 
a school needs assessment, include evidence-based 
interventions, and identify resource inequities. Stakeholders 


must be involved in planning. In schools identified for 


comprehensive support and improvement, ESSA guidance 
emphasizes the importance that improvement plans address 
all learners in the schoal, especiaily the lowest-achieving 
stucenis$ 


The nonregulatory guidance issued by ED further specifies that 
the school needs assessment muss address how the selected 
school improvement methods and strategies wil 


*  slrengihen the academic program in the school: 
* increase the amount and quality of learning time; and 


+ provide an enriched and accelerated curriculum, which 
includes programs and activities needed to provide a well- 
rounded education, 


States and districts can follow this same process for implementing 
targeted inierventions fo ensure that the interventions are 
matched properly fo the specific challenges encountered by 
the relevant schools. Bul how should a school develop its needs 
assessment to ensure, to the greatest degree possible, maximum 
accuracy and that the needs of all learners are met? 


Schools have been doing needs assessments for years, and 
there is no shortage of guidance on how bes? io conduct 


them. Several proprietary tools enable districts to organize 

data to facilitate analysis and presentation. One example is 

the “Adaptive System of School Improvement Support Tools™ 
{ASSIST™¥)"¢ from AdvancEd; a second is from Indistar.” Some 
states have creaied resources to guide districts in constructing 
their needs assessments. Virginia.* Arkansas,” and Colorado! are 


among the mast comprehensive." 


Unfortunately, while these various taols and state resources help 
with the needs-assessment process, they cannot get “inside 

the school" to ensure that the process diagnoses the correct 
problem. The directions for completing the needs assessment 
include such phrases as, "Develop the priorities, goals, 
benchmarks based on disaggregated data, which focuses on 
student needs.” and “Design evidence-based action geared 
fowards enhancing student achievement." These tools also 
suggest methods for setting priorities without helping districts or 
states do the prioritizing. 


The question at the heart of the process is this: What exactly is 
causing ihe problematic resuifs in student achievement? This is 
no mean task. For instance, identifying a general misalignment in 
eighih-grade math results belween the curriculum ond the state 
assessment does not fell a schoo! leader if the problem occurs 
across the entire academic skill se? or within a particular domain 
such as algebraic reasoning. A remedy that involves a fulbscale 
curriculum replacement might not only be unnecessary. but it 
also could cause general disruption and a further lowering of 


student outcomes 


in short, the evidence-based intervention supplied by the 
district and supported by the state can be effective only if the 
diagriosis of the problem is accurate af a sufficiently granular 
level to distinguish one or more root cause(s) for students’ poor 


academic performance. 


itis frue that general data points are a key starting point. For 
example, high levels of student and/or teacher absences 
strongly correlate with weaker student results, so finding high 
levels of either is a warning sign. But the nex? stage means 
digging deeper: is there an especially high rate of absenteeism 
among certain grade levels, or certain student subgroups, 
and/or at certain times of the year? Different findings point to 
different interventions. 


In the end, a strong needs assessment should produce a fine- 
grained analysis of what is happening in student tearning and 
an effort to correlate that analysis with adult behaviors. Such an 
assessment can enable the schoo! to select the intervention that 
has the best chance of changing adult behavior that research 
has shown will increase student performonce where that 
performance is most seriously challenged. 


Elements of an Effective School 
Needs~Assessment Tool’® 


Based on the theory of action outlined above, an effective 
schoo! needs-assessment tool would include at Jeast these four 
critical elements: (1} organized display of data; (2) granular 
performance data: (3} theory of action for data collection; and 
{4} crosswalk between adult actions and student achievement 
data. 


No accurate school needs assessment can be done without 
relevant empirical information. An effective fool will generate 
a daia-rich profile of students' academic performance with 
eccurate schoo! climate indicators included. All the ESSA- 
required data, as interpreted by ihe state, and additional 


- data will be here: {1} multiple indicators of student academic 


achievement and growth; {2} history of gap-closing results 

for student subgroups {if available}: (3) comparisons to 

other schools; and [(4} full transparency on student subgroup 
achievement. There is no single "best in class" example needs- 
assessment fool, but schools in Ohio,'*New Jersey, and 
Colorado" offer promising examples that require rich data sets 
io inform the starting point of ihe needs assessment. 


Granular Perform: Sola 


Beyond excellent schootlevel assessment and climate data, 
chief state school officers and superintendents need to 
undersiand what is going on inside the numbers. For instance, 
what aspects of English language arts or math, exactly, cause 
students to struggle and how many students struggle with 
them? What percentage of students belongs to one or more 
student subgroup? Louisiana offers one example of how a state 
education agency (SEA} uses additional descriptors fo provide 
schools with information beyond basic performance categories, 
which SEAs provide to schools in template form. Schools in other 
states that have access to diagnostic, formative, and interim 
assessment data can use Louisiana's example as a model or 
create their own templaie, The key principle is the same: schools 
cannot intentionally improve what they cannot identify.” 


A 


Action for Data Collection 


Once a school has basic student-performance data on hand, 
the school can dig into the crucial aspects of adult behavior 

that potentially impact student achievement results, Because 
there is a potentially unlimited universe of possible data, schools ; 
need to set organizing and operating assumptions at the 

front end to guide their inquiry. The New York State Education 
Department (NYSED) offers a self-diagnostic tool that contains 
useful elements fo guide this work; however, the tool is purely 


qualitative. A more helpful model would include a Liker! scale 
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ta weight the level of performance in each domain. This would 
enable a school needs assessment fo prioritize the areas for 


evidence-based interventions. 


Instruction is at the core of this school-based adult behavior 
diagnostic. What are teachers teaching and how effectively are 
they teaching it and, in both cases, why? An effective needs- 
assessment toal will prompt granular consideration—by teacher, 
subject, and grade level—of what school leaders know and 

do not know about enacied curriculum; degree of alignment 
horizontally across grades; and extent of vertical alignment 
{from one grade jo the next) in subject matter. The fool also can 
answer questions about teacher effectiveness. For example, 
have the principal's observation results been correlated with 
student academic growth data? What has changed in the last 
year in terms of instruction—content in subject or grade level, 
teaching or leadership personnel, key mandates. professional 
development, ond parental outreach and involvement—and 
what has nof changed in theses domains? 


tive needs-assessment icol will set out what the school 


is doing in these domains out restrict the reporting to 
areas in which data supports the findings. 


The final operation the tool will prompt and support is the 
crosswatk-—the school’s best effort to link specific adult behaviors 


to specific problematic student academic outcomes, With the 


HOY AlGOR vate. my Adeaey tor : 
wetican Education: Images of feacters and Students in Action 


assistance of a iheary of action/best practices metric, the school 
will define adult action both positively and negatively, as in "X is 
doing, oF is nof doing, A” {where X is one or more adulis and A 
represents o specific action). The key is io avoid impressionistic 


evaluation, such as "X is nof doing A very weil.” This is a lirnifation 
of the NYSED diagnostic foot, which describes feacher actions 
with words such as “beginning to” rather than in concrete ferms 
such as “in eighth grade, teachers meet for two and one-half 
hours a week fo share their standards-aligned lesson plans for the 
following week and make modifications to ensure alignments 
and subject-matter coherence across grade" or “teachers in 


eighth grade do not share their lesson plans with each other.” 


No needs-assessment tool fully focuses on the granular data 
in areas that research shows matter the most for effective 
instruction, which requires the close alignment of the following 
critical factors: 


+ Formal curiculum supported by research that shows a strong 
studeni impact {see the next section about researched- 
based practices} 


+ Evidence that teachers teach thot curriculum and share 
bes! practices and challenges regularly {ideally weekly} with 
granular data on student performance as their key input 


+ Alignment between regular in-class assessments embedded 
in thot curriculum and more formal formative, interim, and 
state-mandated summaiive assessments 


District Action: Link fo Research- 
Based Practices 


When the needs assessment is done effectively, districts, with 
possible assistance from their SEAs and regional educational 
laboratories {RELs}, con match research-based interventions. 
to the most critical challenges identified by a low-performing 
school, following these broad steps: 


+ Literature review. Find relevant, research-bosed literature that 
identifies strategies to address the weakness that showed up 
in the data. Keep in mind that context matters for strategies 
to succeed, School leaders should compare the research 
settings to those in their state or district. 


* Benchmarking, Examine how similar states or districts 
implemented solutions to handle similar needs. 
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+ Multi-attribute utility technique (MAUT). Develop criteria 
against which each solution strategy is rated. MAUT resuffs in 
a summary of ratings for each solution strategy, which schoo! 
leaders can transiate into a list of sirategies with the highest 
potential for addressing their specific need. This is a helpful 
approach because it requires that schoo! leaders identify ihe 
most important criteria for addressing each of their identified 
needs, 


* Quality function deployment. identify key components of 
program design features and determine the likelihood that 
they will resolve the needs the school has identified.” 


The capacity of schools and districts to research best-evidenced 
inferventions will vary immensely. Below are some of the bes} 


resources to use. 


ct Works € 


WWC} offers a summary of 


pre-K-12 educational interventions that have been the subject 
of strong research that matches Tier } {randomized control 
trial} or Ter 2 (quasi-experimental) as defined by ESSA. WWC 
recently redesigned its web pages to be user-friendly. Readers 
can home in on subject areas, and fhe site will rank-order 
interventions according te the research strength that supports 
them 


Unfortunately, the research base is very thin, or even non- 
existent. for some student subgroups, including English language 
leamers (ElLs} and students with disabilities, It is only when one 
turns to interventions that apply fo a specific racial group that 
the WWC becomes helpful, For example, a search for the topics 
of fiteracy, high school grades, and “block,” yields fen programs 
listed as “fully relevant” to this student population. However, 
dritfing down into the actual research studies shows thai even this 
promising list turns out to be modest, with interventions inciuded 
in which the impact is so minor that one could hardly adopt 
them wilh confidence. 


Best Evidence Encyclopedia 


Bast Evidence Encyctopedia (BEE) is similar io WWC in using 
a high bar to identity strong research studies. If has launched 
a user-friendly tool, § ‘4, that explicitly links the 


research base for a variety of interventions fo the ESSA evidence 


requirements. Readers can search for interventions using the 
same filters as with WWC—subject. grade level, evidence rating, 
and population served—bui with new filters thai will enable 
users fo further narrow their search. New filters Include objectives 
{e.g.. phonics or reading comprehension}, community {ie., rural, 
urban, suburban), and distinctive features {e.g., technology, 
professional developmen, family focused, or jextbeok/ 
curriculum}, 


More importantly. ihe enhanced 8E€ includes research 
findings that qualify for Tier 3 of ESSA‘s research standards 
interventions defined as “promising.” those correlational 
studies thai cannot generate causal claims but indicate 

that student outcomes moved in o particular direction affer 
the intervention was introduced. When interpreted with due 
caution, such studies could resull in the inclusion of far more 
research-based interventions, thus offering users a more real 
world tocl, especially in domains such as special education 
and ELL where a paucity of research makes evidence-based 
interventions difficult to identify. For specific research studies that 
identify interventions targeted jo these student subgroups, see 
Appendix: Studies on English Language Leamers, Students with 
Disabilities, and Students from Low-income Families, 


Evidence from Bast Practices 


Finally, school leaders might turn to evidence from bes! practices 
in addifion fo the major clearinghouses and to individual studies 
for examples of promising targeted interventions. For instance, 
Claude Goldenberg's “Teaching English Language Leamers: 
What the Research Does and Does Not Say" lays oul the 

findings from two meta-analyses of research on teaching ELLs,” 
However, it is difficult for readers to know how much to rely upon. 
the stated findings, since the level of rigor is voriaibte and would 
not be included in WWC or BEE. 


On the other hand, the fect that an instructional approdch has 
not yet been subjected to rigorous study does not mean it is 
not worth considering. Schools rightly hesitate to implement an 
intervention where a study finds a connection between that 
intervention and gains in scores or high school graduation rates 
without having controlled for other factors. Nevertheless, when 
faced by an aimost empty ESSA Tier } or Tier 2 research record, 
studies showing robust, multi-year demonstrations of success 
make the practices worth considering. A few examples follow. 


97 


One such example comes from the record of the Internationals 
Network for Public Schools (internationals schools} in New York, 
where each school is comprised ef 100 percent ELLs. Findings 
from @ 2005 study show extremely posifive evidence of increased 
high school graduation rates and low drop-out rates. Among 

the best practices the researchers report are language and 
content integration; language skills are most effectively learned 
in context and emerge most naturally in purposeful, language- 
rich, experiential, and interdisciptinary study, At the internationals 
schools, all learners—facully and students—experience the same 
model, which maximizes their ability to support each other 


A meta-analysis by Thomas Scruggs from George Mason 
University and his colleagues examines seventy experimental 
and quas-experimental studies involving interventions for 
secondary-grade students with special needs. Their analysis 
shows that both explicit and mnemonic instruction have positive 
effects on student achievement. 


Explicit instruction uses practices such as teaching in small steps, 
rules-based instruction-quided practice, and independent 
practice to convey fearing. Two studies show positive 
achievement for students’ learning under this model. Each study 
employs a different explicit-instruction technique. 


« One study of rules-based instructions for teaching the 
scientific method finds that students with disabilities 
receive higher achievement gains than those using. more 
constructivist instructional methods.” 


* Aseparate study” finds learning gains when students with 
learning disabilities are taught social studies using smotier 
instructional units, following each unit with student practice 
and teacher feedback. 


Mnemonic instruction has a more robust research base of 
twenty-one studies that show potential effectiveness. Mnemonic 
instruction links new information to prior knowledge through 
visual and/or acoustic cues, Keyword and peg word are wo 
commonly used approaches within mnemonic instruction. 
Keyword uses familiar sounds to the word being taught. then 
uses pictures fo link the two words; peg word uses rhyming words 


to help students remember sequential order. 


Both techniques are effective in teaching English vocabulary 
words. characteristics of animals,” and U.S. history.® Scruggs 
and his colleagues note that mnemonic instruction “is targelf[ed} 
specifically fo verbal associative learning and does not address 
all aspects of content area learning.’ 


Pulling It All Together: The School 
Improvement Plan (SIP) 


Asis the case for schools’ needs assessments, SIPs ore. i 
themselves, nothing new. Under NCLB, the federal government 
required that schools officially designated as “in need of 
improvemeni" use SIPs. ESSA requires the use of SIPs as well, as 
outlined at the beginning of this report 


However, in the absence of the needs-assessment steps outlined 
previously, the SIP is only of modest use. Without an exacting, 
granular self-assessment, a check by an external visiting team, 
and the coreful maiching of strongly researched interventions 
to the specific identified needs of schools, SIPs will capture best 
intentions but will fail to improve student learning. 


Given this, the evidence on SIPs is not surprising: the quality 

of the SIP and its relationship to ongoing school improvement 
correlate to student outcomes. There is little overall evidence 
about the effects of SIPs on student learning.” However, there. 

is some evidence of a positive correlation between high-quality 
SIPs and student learning. A study of Clark County School District 
{CCSD} in Nevada, at the time the fiffh targesi school district in 
the country, finds a consisiently significant relationship between 
the quality of the SIP and student learning in math and reading, 
even after controlling for many school characteristics. SIP quality 
in this study was determined by a rubric created by CCSD and 
Nevada's Leadership and Learning Center which graded SIPs 
on seventeen indicators* on a scale of | to 3 (the highest rating}, 
The study finds that “how frequently the SIP was monitored” and 
“the iimetiness of SIP plan goals” are the two dimensions of SIPs 
most strongly associated with increased student learning.* 


Another study finds that higher-quality SiPs positively correlate 
with student achievement, but once student and school factors 
are conirolied for, there is no statistically significant relationship 
between higher-quality SIPs and student achievement.” 
Meanwhile, a separate study examines the relationship belwéen 
SIP quaiity and pian implementation by studying a school 
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improvement initiative in the Los Angeles Unified School Distict 
{LAUSD) that relies on formal schoo! planning. The researchers’ 
findings show that the average SIP quality was low throughout 
the initiative. They did, however. find a positive correlation 
between the relative quality of particular SiPs and reported 
implementation outcomes in the first phase of LAUSD’s initiative * 


The effects of a high-quality SIP are compounded when the 
school undertakes an ongoing improvement process. Research 
findings show more powerful effects from ongoing school 
improvement processes, rather than from SiPs alone,” For 
example, a four-year evaluation af schools’ experiences in 
implementing the Scaffolded Apprenticeship Model [SAM}* for 
inquiry-based school improvement in New York City finds that 
schools that heavily invested in SAM developed c culture of 
inquiry and that student achievement improved. For example, 
schools with continued teacher involvement in the SAM 


credentialing program had a significantly targer proportion 

of students on frack for high school graduation and college _ 
readiness, and a stnailer proportion of students off track for high 
scheol graduation by their junior year, than other schools with 


similar student populations, 


Site Visits 


in many instances, the issuance of the SIP is the last format 
requirement of jhe schoolreform process until interim and/or 
summative performance data must be produced. However, 
there are two critical steps in the process at which an external, 
on-site review of the workings of the school could add important 
quality assurances to what otherwise is an entirely local effort: 
{1] when the school is finalizing its needs assessment, and {2) 
offer a reasonable number of months have passed and the 
implementation of the selected intervention(s} is well underway, 


The site visit is an idea borrowed in part from the inspection 
process conducted by the Office for Standards in Education, 
Children's Services and Skills (OFSTED) in the United Kingdom.* 
in the British case, the purpose of sending a carefully prepared 
team into a school is partly for accountability and partly for 
diagnostic purpases. New York adopied a somewhat similar 
model buf strictly for the diagnostic purpose. The key value-add 
in holding such a visit prior to completing the needs assessment 
is to enable an outside analysis of the degree to which the 


school accurately has self-diagnosed its unique challenges. The 


purpose of the second visit is fo evaluate the degree to which 
the selected interventions are being implemented effectively, 
wiih the requisite support and feadership from the school. in both 
cases, the aim is to moximize the poiential for the entire school 
improvemeni effort to show positive impact on student learning. 


NYSED states that “lejach year, ihe Commissioner will appoint 
an integrated intervention Team {IT} to conduct an on-site 
diagnostic disirict review and school reviews of selected 
Priority and/or Focus Schools within the district fo inform the 
developmen} of the District Comprehensive Improvement Plan 
and Schoot Comprehensive Education Pian .,.."“ NYSED also 
provides the following guidance: 


The review will be carried out over a period of ane, two, 

or three days by on integraied intervention Team {IT} 
composed of NYSEO staff; an Outside Educational Expert 
selected by the district ond approved by NYSED; a district 
representative; and in some instancesexperts in the 
education of English language learners and/or students with 
disabilities. The length of the review will depend on the size 
of the school and its accountability status. The process of 
conducting the reviews will focus on collecting and assessing 
low-inference data, {data of what is actually observed and 
heard, absent of added meaning, assumptions, conclusions 
and beliels} fo evaluate school and district practices based 
on six tenets, The six teneis are: 


Tenet |: District Leadership and Capacity 

Tenet 2: Schoo! Leader Practices and Decisions 

Tenet 3; Curriculum Development and Support 

Tenet 4: Teacher Practices and Decisions 

Tenet S: Student Sacial and Emotional Developmental Health 
Tenet 6: Family and Community Engagemeni# 


NYSED provides a set of high-level guiding questions to arent its 


visiting teams prior to their school visits, 
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Conclusion 


Too often, the approach to improving underperforming schools 
resembles a docior irying fo treat a patient's condificn without 
an accurate thermometer and with litfle knowledge of medical 
research, While school districts know which schools are struggling 
to bring students to grade level, they ofien lack the fine-grained 
knowledge that would give them o truly accurate “reading” of 
the school among the many factors that can impact student 
orformance. Bul when armed with accurate granular data: 


instruments supported by on-site analysis from experienced 


teachers and schoo! administrators, schoo! and district leaders 


can identify and prioritize the most critical causes of students‘ 


poor performance. Once equipped with an accurate diagnosis, 


leaders can vet potential interventions. in each case they 

can consider whether the intervention has been compared to 
alternatives based on the bes! available research in terms of ifs 
relevance to the school's population and context. intervention 


impact, implementation challenges, and costs. 


i Re 


Finally, because top-down inierventions so easily can alienate 
those adults (namely teachers and school leaders} whom the 
interventions are intended to support, district leaders have the 
opportunity, with the support of the state, fo embed the process 
of diagnosis and intervention selection in a comprehensive 
structure involving school personnel and parents, among 

others. The time has come for transparency. research, and 
commitments from schools, districts, and states to work together 
to bring the most effective assistance possible fo those who are, 
every day. tring to make a difference for students who need i? 
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Appendix 


tt is possible for education leaders fo cary the What Works Clearinghouse (WWC} and Best Evidence Encyclopedia {BEE] further by 
investigaiing individual studies the clearinghouses reviewed. The research cited from these two sources is not, however, exhaustive of 
ail that is available. in particular, the redesigned BEE toot (Evidence in ESSA} uses selection criteria that are narrower than the pre- 
existing BEE database fram which the tool is drawn. the researched interventions included in the following sections boosted learning 
for English language learners (ELLs). students with disabilities, and low-income-siatus middle and high school students. While this list 
prioritizes those studies that find a statistically significant impact and large effect size for a given intervention, it also includes examples 
of high-quality studies that do not reach statistical significance. Statistical significance is tied to such things as sample size, and there 
are well-designed research studies with modest sample sizes that cre nevertheless worthy of atiention. 


CHNETS 


lish Longuag 


oo Study | : interventian® © Research Design Centex Students Studied Filect Size” | 


Pathway Project. > ~S Jé secondary schools in 
{professional Anaheim, CA 575 10th-grade. 
Olson et al, » development) Cluster A 7 students (313 
{2017}* randomized 68% Latino, 18% Asian, experimental group, 
Whole school ©. . 12% white, 21% ELL;:71% free. 262 contiol group) 
(2 years} i or reduced-price lunch 


Pathway Project is a professional development program for teachers whose studenis include ELLs who can participate in standard 
English classes. Pathway focuses primarily on writing but includes reading comprehension strategies.“ In this study, teachers received 
forty-six hours of training each schoo! year (via six, six-hour released days scattered throughout the school year and five, iwo-hour affer- 
school sessions) over a two-year period. 


Researcher Carol Booth Olson, director of the UCI Weting Project at the University of California, Irvine, and her colleagues employed 
amultisite, cluster, randomized field trial design. They selected sixteen secondary schools and randomly assigned the teachers to 
either the Pathway Project or the control group. The research fearn randomly selected one of each teacher's classes to participate 
in the study, and randomly assigned students to that class for each teacher. Using the California High Schoo! Exit Examination English 
language arts (ELA} scores as a measure, Pathway students scored non-significantly higher at the cluster level (+.19}. controlling for 


California Standards Test pretests. This effect size suggests thaf the average studeni, starting at the 50th percentile, would move to 
roughly the 58th percentile after his or her teacher received Pathway professional development, An effect size of 19 also translates 
into roughly 143 days of additional ELA learning arnong tenth graders. This means that these students gained an additional 143 days 
of learning beyond what they would have fearned had their teachers not received Pathway professional development. These findings 


largely replicated another randomized contro} trial of the Pathway Project that took place in California's Santa Ana Unified School 
District.” 
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“TABLE 2: Academic Language instiuctl for all Students (AUAS) 


| Inlervention ch Desigr f _ Students Studied 


: 476 sin-grade 
paral i siudents (296 
insti ts Tor All 7? middie schools is‘an urban. | experimental group; - 
Lesaux et at oe Cluster quasi. southwestern district’. |. 180. control group)’ | 
12010)! Studenis (AUAS) Sy perimental i | 
49% Latine, 73% ELL ; 2) classes (13 


Whole class/ fe 
experimental group, 
, School {18 weeks} S control pieaole 


AUAS is a vocabulary intervention designed fo be used forty-five minutes a day in standard English language arts classrooms with 
significant numbers of ELLs, Each series of lessons is based on one informational fext. From that texi, students work on small numbers 
of high-utifity and abstract words. The intervention includes whole-group. smati-group, and independent} activities. Students have 
opportunities for listening, speaking, reading, and writing with the targeted words. 


Lead researcher Nonie Lesaux of the Harvard University Graduate School of Education and her colleagues pre- and posi-tested 
studenis using the Gates MacGinitie Reading Test (GMRT} Reading Comprehension exam. The effect of treatment on GMRT scoring 
was significant feffect size=.15/p <.06} and suggests that the students gained an additional eighty-four days of learning by using AUAS. 


with Discibilities 


Intervention ) Research Design: Context | Students Studied | Effect Size’ 


9th-gradé students from 5 
Title | high schools in wesfeim: | . . 
Massachusetts who tested ©). 456 Hhegrade.:: 


READ 180 between a 4th- and éth- students ih'$.cohioris':) 
ue etal Student . + seve 
as re nee ae Peveat i grade reading fevel 1 {231 experimental 

‘ igeted {} year} group, 228. control 


73% students of color, 19%. | group}. :. i 
students with disabilities, 72% 7 i 


free or reduced-price lunch 


READ 180 Is @ supplemental program for struggling readers in which instructors conduct ninety-minute sessions each day with 
students. The program combines thirty-minufe whole-group instruction with one hour of rotating twenty-minute activities that focus 
on independent reading, small-group direct instruction with the teacher, and use of READ 180's adaptive software, Teachers receive 
content-focused workshops and video instruction to develop pedagogical knowledge and skills. 


Researcher Kimberley Sprague and her colleagues from the Education Alliance af Brown University compared READ 180 targeted 
interventions to control groups to determine effectiveness. The research team randomized cohorts of siruggling-readers across five 
high schools serving predominantly students of color from low-income families. One-fifth of students in the study sample received 
special education services. Statistically significant, positive effects {+.18/p<.03}. or roughly 135 days of additional learning, were found 


for ninth-grade students in the READ 180 treatment cohort as compared to the control group. 


intervention niex Students Studied Efec! (ue” 


| 

7ihegrade students from 

secondary schools in 
© Uondon,-England, reading at: w 
© Isast on year below grade! enon sae i 
. Targeted, snail Soe iG 4 -. level “6experimental. 4.30% 

oe ne i Lote 78% white, 18% Affican group, 149 control 
moins) American, 35% students wilh group} 
©. discbililies; 64% ELL, 51% free: 
of reduced-pri 


ButterBy Phonics 


Meirelland Kasim | 
(2015) 


Butterfly Phonics is a small-group phonies instruction program for strugaling readers, The progrom uses formal phonics instruction, 
comprehensive understanding of text. and class discussion of textual meaning to improve reading comprehension.“ The program Is 
delivered through a format instruction style fo small groups of six fo eight students by a trained practitioner and an assistant. 


Students who read at least one year below grade level were randomly assigned within schools. The contro-group students continued 
to receive regular English lessons. The treatment-group students received two hours of Butterfly Phonics lessons per week and were 
withdrawn from English tessons, although they continued to receive lessons in classes that were taught in the English language. The 
New Group Reading Test {NGRT} measured effectiveness ovlcomes, The analysis by Christine Merrell and Adetayo Kasim, both from 
Durham University in the United Kingdom, found a significant effect size of +.30, or an additional 235 days of learning, in favor of the 
treatment group on the NGRT test. Additionally, these findings were statistically significant at the p<.001 level. 


TABLE & REACH 


Study Intervention © | Research Design | Context ' Students Studied | EHedt Size? 


Lowest readers in 27, 
disadvantaged secondary. 
schools inornear leeds, | 
sic paneer ors 
(20 weeks} randomization | 63% students.with disabilities, | control group} 

i 68% white, 32% studenis of 
color, 24% ELL, 31% free or 

reduced-price lunch 


\ 

ane REACH 
©) Sibieta (2016) 

| 


REACH is a program from the United Kingdom that provides early-secondary school struggling readers with one-to-one tutoring, 
Students receive thirty-five-minute sessions once a week for twenty weeks with specially trained paraprofessionals. During these 
sessions, students read aloud from books at their evel while tuiors keep notes on studeni performance, which serves as the basis for 
remedial teaching. A variation of REACH, REACH-LC, adds a language comprehension element that emphasizes metacognitive skills, 
reading comprehension, inference, and writing.” 


Luke Sibieta, program director at the Institute for Fiscal Studies in London, evaluated REACH and REACH-LC in twenty-seven secondary 
schools in and around Leeds, England. The research team randomly assigned students who scored poorly on the Single Word Reading 
Test to REACH, REACH-LC, or coniral treatments. They were pre- and post-fested using NGRT. Post-test analysis found. statistically 
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significant, positive effects with both the REACH cohort (effect size=+.33, p<.001} and the REACH-LC cohort (effect size=+.51, p<.001) 
over the control group. Averaging across the two variations, ihe mean effect size was +.42, which would transiate into roughly 280 days 


of additional fearning in the United States. Such franstations should be regarded with caution, given that this intervention occured in 
the United Kingdom. 


n Low-incom: 


Students Studied : Hledt Sie?” 
Talent 


Development High : 


School [strategic é nonselective high schools 


Jn Baltimore 457 9th-grade 


Baifainz, Jordan. reading ond " 
Cluster quase Bie ati : students (257 
one legals student team experimental 89% African American; | experimental. group,: | 4.32 
{2004} : wititing) 9% white, >90% free or 200 control: group} 


Whole class/ reduced-price lunch: 


school {} year} 


Talent Devetopment High School (TDHS} is a whole-school reform model. Within the model, the strategic reading component aims to 
develop reading and writing comprehension skills. Teachers provide “read-aloud/think-aloud” demansirations and minitassons on 
comprehension strategies. Time also is allocated for students to self-select reading and writing activities. 


The research team of Robert Balfanz, Nettie Legters, and Will Jordan from Johns Hopkins University selected three well-matched 
schools, Eight teachers used strategic reading in twenty classes. The control schools provided double-dose classes in English and math 
bul followed the district curriculum.’ Post-tes} analysis. controlling for pretests and demographic factors, showed on effect size of +32, 
which is equivalent to roughly 240 days of learning. 


"TABLE 7: One-to-One Laptop Use 


tntervention® Research Design — Context Students Studied Elfect 5 
i : 


Middle schoo! students * » 
{grades 6-8) in'an urban 
| 1:1 Loptop'use schoo! district in a mid-- |. 163 students'in 14 
Durileavy and hae ‘Cluster Atlantic state* \ classes in grades &8 : 
i 


Heinecke (2007}” | Whole schoo! randomized. g}g african American, doce iieetal 


2% Asian, 3% Latino, 13%. | group} 


Lo 2years) 


white, 59.6% free or reduced- | 


price lunch 


elicit 


Matt Dunteavy of Radford University ond Walter Heinecke of the University of Virginia conducted a randomized trial to test the impact 
‘on student test scores of giving students individual laptops as opposed to their using school computers, The study randomly assigned 
163 middle school students to one of two conditions: (1) treatment students received a laptop {Apple iBook/128MB hard drive/OS 
10.2.8} loaded with online mathematics and science textbook access and laptop-based instruction, and {2} the conirol group had 
access fo the same resources in the school’s computer Jab. Researchers used the state standardized fest (SST) to measure outcomes, 
Analysis revealed statistically significant positive effects were found an the SST scores favoring the treatment group {ES=.24/p<.03), or 
roughly an additional 160 days of learning. 
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Sludent Succeeds Act. Legislation Reauthorizing the Elementary and 
ndary Education Act" (Washington, DC: National Conference of 
Stole Legilaies nia), 
cli accessed March 90. 2017) 


for an analysis of these research standards and what they might 
mean in practice see Chiels for Change, “ESSA ond Evidence: Why # 


ESSA states the following about the “fargeted support and 
improvement plan": "{B} JARGETED SUPPORT AND IMPROVEMENT 
PLAN.— Each school receiving « notification descrited in this 
paragraph. in parmership with stakeholders fincluding principals 

ond ather school leaders, teachers and parents). shall develop 

and implement a schootlevel targeted support and improvement 
plan to improve student outcomes based on the indicators in the 
statewide accountability system established under subsection {c} 

{4}, for each subgroup of students that was the subject of notification 
that--{ij is informed by all indicators described in subsection (c} 

(4}{8). inchiding student performance agains! long-term goals: 

{i) includes evidence-based interventions: {ii} is approved by the 
local educational agency prior to implementation of such plan: {iv} 

is monitored. upon submission and implementation, by the lecal 
educational agency: and {v} results in additional action following 
unsuccessiul implementation of such pian atter a number of years 
determined by the local educational agency. {C} ADDITONAL 
TARGETED SUPPORT.—A plan described in subparagraph (8) that is 
developed and implemented in any school receiving @ notification 
under this paragraph trom the local educational agency in which 

any subgroup of students, an its own. would lead to idenfification 
under subsection {c){4}{D} Gi using the Stote’s methodology under 
subsection (¢}(4}{0} shall also identity resource inequities {which 

may include a review of local educational agency and schoo! level 
budgeling}. 10 be addressed through implementation of such plan.” 
US. Department of Education, "Elementary and Secondary Education 
Act of 1965, as Amended by the Every Student Succeeds Act— 
Accountability and State Plans” (2014), 
Gov/leouenannts/205 6/11 729/20 6-2 
BdLGalion-Ucloh 96h ar-omend 
For further details and discussion, see J. Poiner, “School dentifcation 
and Intervention in the Age of ESSA," Flypaper {blog}. Thomas 8. 
Fordham Institute, June 2), 2016, hlips/vedexces : 
schonhidentificenion-angtintervantionsnethe 


ESSA dofines “evidence-based” activity, strategy, or intervention os 
either {1} demonstrating a statistically significant impact on sludent 
achievement based on evidence from at least one weltimplemented 
{) experimental study {i} quas-experimentat study. oF fii} correlational 
study thal controls for selection bias; or {2} demanstrating a rationale 
based on high-quality research that such an activity will ikely improve: 
student achievement and includes an angoing evaluation of the effect 
of the activity. intervention. of strategy. This report refers to research 
that meets the first standard using experimental study as Tier 1; research: 
that meets the standard using quasi-experimentat research as Tier 2; 
and research that meets the standard using a corelational study os Tier 
3. Research that meets the second standard is referred to as Tier 4. 


Sey 
- 


See US. Department of Education, "Supporting School Reform by 
Leveraging Federal funds in @ Schoobwide Program: Non-Reguiaiory 
{Washington. DC: Author September 2014), Ms//ed. gow 


‘Advanctd, ASSIST school improvement fool,” BH: 
asfassis! (accessed March 30, 2017}. 


Indistox, Homepage. i 
rome? for tuther detois about the tool, {accessed March 30, 201 7 


K. Bond and L. Sodat, “Conducting a Comprehensive Needs 
Assessment for the Title f, Part A, Schoolwide Plan,” (Richmond, VA: 

Virginia Deparment of Education, Office of Program Administration 
and Accountobilly Coordinators’ Academy, July 2014}, 


M, Smith and L. Spain, “Conducting a Comprehensive 
Needs Assessment in Your School.” (Arkansas Department of 
Education, Department of Learning Science, July 2014) hites// 


See abo K. £. Fernandez, “Evaluating School Improvement Plans and 
Their Effect on Academic Performance," Educational Palicy 25, no. 2 
{2011}: 338-367, 347. for a fist of seventeen research-based indicators of 
high-quality SIPs for additional components to include. 


Such language appears across many of the schoo! needs assessments, 
The second phrase comes from Arkansas's school needs assessment. 


Hements of this section are drawn from material prepared for an 
intemal memo to Chiefs for Change, The Institute is grateful to Chiefs for 
Change for permission to use this material. 


Ohio Department of Education, Horace Mann Pre-K-8 School Report 
cation.ohio.qov/Pages/Schaah 
s8ahlips//repartcard. education. ohio. gov? 
xSSCHGGURN=O | 6840 (accessed March 31, 


State of New Jersey Department of Education, Alexandria Township: 
Middie School: Schaol Report Card 2014-15, hBp://wyw state.) vse 
WAT 4T SATII 9OO2000S pail (accessed March 31, 2017}, 


Colorado Department of Education, “SchoolView: Data & 
Accountability.” Atlps nwww.cde state.ca.us/schooliew (accesséd 
March 3}, 2017}. 


The Louisiana data wos provided by the Louisiana Department of 
Education in a private conespondence. 


New York State Education Deparment (NYSED), “Office of 
accounioe Pow Tool for Effectiveness,” hitou www, . 
Fagnostictoolinstilule/nome Ain! 
{accessed March 7, 203 LYSED, “Diagnostic Tool for Schools and 
District Effectiveness FAQs.” June 2015, hiipyAwew.plunysed.geys 
FAQS, 


2 


a 


JW. Allschuld and 8. 8. Witkin, From Needs Assessment fo Action: 
Transforming Needs inte Solution Strategies (Thousand Oaks, CA: Sage 
Publications, 2000} 


U.S, Department of Education, institut 
Works Clearinghouse: Welcome Page. 
laccessed March 31, 2017). 


of Education Sciences. “What 
Rowe, 


WWE comibines the qualily of research, sheer number of research 
studies that made it over the bar for inclusion. and actual impact on 
learning thal the research suggests occuts due te the intervention. Only 
by digging into the supporting materiak can the user disentangle these 
plements 


* C. Goldenbarg, "Teaching English Language Learners: What the 
Research Does—and Does Not—Say," American Educator, Summer 
2008. 


> M, fine, B, Stoudt, and V. Futch, The Internationals Network for Public 
Schools: A Quantitative and Qualitative Cohort Analysis of Gradvation 
and Dropout Rates [New York, NY: The Graduate Cenier. City University 
ot New York, June 2003), : 


Fre 


1. £. Scruggs et at, "Do Special Education interventions Improve 
Learning of Secondary Content? A Meta-Analysis,” Remedial and 
Special Education 31, no. 6 {November 1, 2010}: 437-49, he 


The mean effect for explicit instruction was 1.68 and the mean effect 
for mnemonic instruction was 1.47. The mean effect size indicates 

the magnitude of the effect an intervention had on the group that 
received the treatment versus a Comparison group, Researchers do no} 
usually franstate effect sizes involving special education students into 
additionat days of learning. 


J A. MeCleary and G. A, Tindal. “leaching the Scientific Method to Al 
Risk Students and Students with Leaming Disabilities Through Concept 
Anchoring and Explicit Instruction.” Remedial and Special Education 


P. Hudson, "Using feacher-Guided Practice to Help Students with 


Learning Disabilities Acquire and Retain Social Studies Content 
Learning Disability Quarterly 20, no. 1 (997): 23-3% 
ERD, COMMU ERAT, 2 3077 EST TOPO, 


M.A, Mastropier, 7. €. Scruggs. and C. Whedon, “Using Mnemonic 
Shategies to Teach Information about U.S. Presidents: A Classroom- 
Based Investigation.” Leaming Disability Quarteily 20, no, | (1997): 
121, php Journes sergepey.camn/sdol elas 10.2307 /4 8) 1089, 


LE, Scruggs of al, “Effects of Mnemonic Reconstructions on the Spatial 
Leaming of Adolescents with Learning Disabilities.” Leaming Disability 
Quarterly 15, no. 3 (August 1992}: 154-82, hitp://jovinas sagepub cory 
choidentoy/ 10.2307 71510240. 


1, € Scruggs and M. A. Mastropier, "Mnemonic instruction of LO 
Students: A Field-Based Evaluation 
12, no, 2 {1989}: 119-25, tke /HHournas 
cates 10.27 FS 10727, 


Seruggs et al., "Do Special Education interventions improve Learning of 
Secondary Content?" 


e 


SIPs are required in ESSA. See endnote 3 for defaits, 


8. S. Elfinger, “Shifting from Plan to a Process: School improvement Plans 
in Combridge Public Schools” (doctoral dissertation) Harvard Univesity, 
2015. 


The rubric was designed fo be used across the United States and 
Canade and was created by examining SIP templates in use in the 
United Slates and Canada and by seviewing the literature on best 
practices of SIPs. 


Exampie indicators include {1} comprehensive, which measures it 
goal are connected fo concems and causes identified in the SIF: 

{2} measurable goal, which measures if goals are quantifiable and 
include 6 baseline and target measure: and {3} manitoring plan, which 
measures if there are moniionng steps in places that explicitly describe 
what will be done to assess progress toward each geal. 


K. & Fernandez, “Evaluating School improvement Plans and Their Effect 
on Academic Performance.” 


D. J, Huber and J. M. Conway. “The Effect of School improvement 
Planning on Sluden! Achievement," Planning and Changing 46, no. 1/2 
(2015): 56. 


K. O. Strunk et al. “The Best Laid Plans: An Examination of Schoo! Pion 
Quality and implementation in a Schoot Improvement Initiative," 
Educational Administration Quarterly 52, no. 2 {2016}: 259-309. 


V. Bemhardi, Data Analysis for Continuous School tmprovement (New 
York, NY: Routledge, 2013].: G.J. Langley, The Improvement Guide: A 
Practica! Approach to Enhancing Organizational Performance., 2nd 
ed. {San Francisco: Jossey-Bass, 2009}. 


SAMis G weltdefined model of school change that emphasizes 
collaborative inquiry and teacher jeadership in which a team of 
teachers uses student dais to identify specific teaming gaps and 
develop targeted interventions, 


J. €, Talbert ef al., inquiry-Based School Reform: Lessons from SAM 
in NYC (Center for Research on the Context of Teaching; Stanford 
University, 2012). 


“OFSTED Home Page.” Government of the United Kingdom, Hips: 
sofions/ofsied {accessed March 31, 


2017). 


NYSEO. “Diagnostic Toa! for Schoo! and District Elfectivoness {DTSDE|” 
{Albany, NY: Author October 2015}, lille gov! 
accou s/OTSDROHentedtanitoy 


————, “Office of Accountability: Diagnostic Tool for Effectiveness.” 


* X, Fan, “Statistical Significance and Effect Size in Education Research: 


Two Sides of a Coin,” Joumol of Educational Research 94, no, § (2011): 
275-82, httos! Awww jstorarg/stcible/2754293: gel #indinreferences,, 


Duration of the intervention appears in parenthesis. 


Statistical significanc: 


<.10, *p <.05. "p< 01, p<. 001, 


106 


* C.B. Oken et al, “Reducing Achievement Gaps in Academic Wating 
for Latinos ond English Leainers in Grades 7-12." Journat of Educafionat 
Psychology 109, no. 1 {2017}: 1-24. # 


* A. Baye et al, “Effective Reading Programs for Secondary Students” 
(Baltimore, MD: Johns Hopkins University Schooi of Education's Center 
for Data-Driven Reform in Education, December 2014}. 


*® C.B. Obon and R. Land, "A Cognifive Strategies Approach to Reading 
and Writing Instruction for English Language Leames in Secondary 
School” Research in ihe Teaching of English 41, no. 3 {2007}: 269-303. 


* NK, Lesaux ef ol, “The Effectiveness and Ease of Implementation of an 
Academic Vocabulary Intervention for Linguistically Diverse Students in 
Urban Middle Schools," Reading Research Quarierly 45, no. 2 (2010}: 
196-228, iui 


? K, Sprague et al. “Springfield-Chicopee Schoo! Districts Striving Readers 
{SR} Program Final Report Years t-5: Evaluation of Implementation 
and impact" {Providence, 1: Research & Evaluation Division of us 
Education Alliance at Brown University, March 2012}. 


°C. Menelland A. Kasim, “Butterfly Phonics: Evaluation Report and 
Executive Summary” (London, UK: Education Endowment Fund, 
February 2015) 


This study was included in the original research view using resources 
in BEE, This material is not included in the ESSA-related tool as this is 
inlernational research. 


5 Effect size is a pooled effect size. The effect size for alt students was .43. 
Separate analysis was conducted for students who qualify for free or 
reduced-price lunch. Effect size for this group was .16. 


1, Sibieta, "REACH Evaluation Report and Executive Summary” 
(London, Uk: Education Endowment Foundation, February 2014). 
Hiitpsufedenationencow: 

Compaigns/Evaivetion 8 


* Baye et al, "Effective Reading Programs for Secondary Students.” 


R, Baltanz, N. Legters, and W, Jordan. Catching Up: Impact of the 
Talent Development Ninth Grade Insiructional interventions in Reading 
ancl Mathematics in High-Poverty High Schools (Batlimore. MD: Johns 
Hopkins University Center for Research on the Education of Padens 
Placed at Risk, Decernber 2004), filtro: / feigned gow se 


Baye et al, “Effective Reading Programs for Secondary Students.” 


M. Dunleavy and W. F. Heinecke. "The impact of }:1 Laptop Use 
on Middle School Math and Science Standardized Tes} Scores," 
Computers in the Schoals 24, na. 3-4, 7-22. [2007]: 7-2: 
tandfonting com/ctoy ate) 10.10/82 5V 2803 92, 


Researchers in this study chose not to identify the state and district. 


oe 
oo 


107 
[Additional submissions by Mr. Scott follow:] 


108 


| vocac 


INSTITUTE / 


A not-for-profit organization dedicated to services and projects that work to 
improve the lives of children, youth and adults with disabilities 


STATEMENT ON IMPLEMENTATION OF THE EVERY STUDENT SUCCEEDS ACT 


July 18, 2017 U.S. House of Representatives 
Education and the Workforce Committee 


The Advocacy Institute is watching with interest the implementation of the Every Student Succeeds Act 
(ESSA) with a particular focus on how the law’s new provisions can be used to improve services and 
outcomes for the nation’s 6 million students with disabilities. Our organization, in collaboration with the 
National Down Syndrome Congress, has reviewed more than 30 state plans (drafts or submitted) and 
provides detailed analyses at www.Advocacyinstitute.org. 


The purpose of ESSA—to provide all children significant opportunity to receive a fair, equitable, and high- 
quality education, and to close educational achievement gaps—can only be realized for students with 
disabilities if states and districts do the following: 


® Ensure the interests of students with disabilities are represented in all levels of planning and 
implementation in respectful, meaningful ways. Many states have not included representatives of 
students with disabilities in plan development activities. 

® Place a high level of both importance and urgency on improving results for historically underperforming 
groups of students in order to close achievement gaps. Students with disabilities are most frequently 
the lowest performing student group on state assessments and the National Assessment of Educational 
Progress (NAEP). Too many states seek to merely continue past trends or accelerate only slightly. 

© The improvement activities already underway through State Systemic Improvement Plans (SSIP) and 
the Results-Driven Accountability (RDA) initiative are integrated with ESSA plans and implementation. 
Few state ESSA plans reflect any coordination with the SSIP and RDA, 

* Adopt policies that ensure maximum accountability for performance of student groups. Key among 
these are establishing a minimum subgroup size (N-size) that ensures that, to the extent practicable, 
each subgroup of students is included at the school level for annual meaningful differentiation and 
identification of schools in need of improvement and rigorously enforcing the annual measurement of 
achievement requirement. Many states are adopting N-sizes that will leave far too many schools 
unaccountable for historically underperforming student subgroups and are not fully adhering to the 
requirements regarding annual measurement of achievement. 


In addition, the U.S. Dept. of Education (ED) must continue to fulfill its critical role of monitoring ESSA 
planning and implementation through statutorily required Peer Review and Secretarial Approval. To date, 
ED interim feedback letters and peer review notes reflect valid finding in some respects but should be more 
consistent across states. Further, as this is within the Secretary's authority, it should also scrutinize each 
plan for adherence to ESSA’s equity requirements. 


P.O. 80x 565 ¢ Marshall, Virginia 20116 ¢ Phone 540.364.0051 « www.Advocacyinstitute.org 
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PAA The Council of Parent Attorneys and Advocates, Inc. 
Protecting the Legal and Civil Rights of Students with Disabilities and Their Families 


Statement on the Implementation of the Every Student Succeeds Act (ESSA) 
Submitted as testimony to the House Education and Workforce Committee 
“ESSA Implementation: Exploring State and Local Reform Efforts” 

July 18, 2017 


The Council of Parent Attorneys and Advocates (COPAA) is committed to the effective implementation of 
the Every Student Succeeds Act (ESSA). Our longstanding work with the Congress, the Department of 
Education, our national membership and key partners in the disability, civil rights and business 
communities has consistently focused on improving the educational outcomes of the 6.4 million school-age 
children with disabilities and other disadvantaged students. COPAA views ESSA as vital and necessary to 
helping states provide the resources, training and guidance that schools and districts need so that ESSA’s 
purpose ~ to provide all children significant opportunity to receive a fair, equitable, and high-quality 
education, and to close educational achievement gaps! may be achieved. COPAA understands that states 
now have more discretion to carry out the provisions of ESSA, however, as many prominent Members of 
Congress, witnesses before this committee and leaders of major organizations across the political spectrum 
have said, ‘with new flexibility comes new responsibility’." It is this important balance ~ between 
flexibility and responsibility that we wish to address. 


When Congress used its authority under the Congressional Review Act to rescind final regulations on 
ESSA’s accountability provisions" earlier this year, this action placed the Secretary of Education in the 
role of full interpreter and arbiter of the statute. While COPAA preferred the situation where final federal 
regulations prevailed, as compared to a raw-statute-implementation situation, this is now the circumstance 
under which the law will be carried out. Therefore, we urge Congress to fully support the Secretary in 
doing what is required ~ to oversee full implementation of the statute, as it is written. States must be held to 
every obligation therein. 


In February 2016, COPAA’s legal director, Selene Almazan, Esq., testified to the House Subcommittee on 
Early Education, Elementary and Secondary Education and said: 


...states’ provisions that restrict entitlements established by federal statutes are 
void under the Supremacy Clause of the Constitution. The Supreme Court has 
applied this principle in cases regarding benefit programs in which the federal 
government provides funding to states on the condition that they comply with the 
terms of the federal program, the same arrangement that exists for special 
education under IDEA, The Court held that the state was not free to adopt a 
definition that restricted benefits in a way the federal statute did not specifically 
authorize.” 


To this point, COPAA is appreciative of the most recent feedback from the U.S. Department of Education 
(ED) provided to states. The current efforts by ED to assure states submit plans consistent with the statute 
are important and must continue. With only sixteen states having submitted plans, the bulk of ESSA state 
plans are yet to come. Therefore, it is imperative as ESSA plans are formally peer reviewed that the 
Secretary uphold the statutory requirements of ESSA, communicate any incongruities found after initial 
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review, and require strict adherence to the law as written. This will help guide states still developing and 
finalizing plans to adhere to the requirement of the law. 


It's clear from COPAA's review of state plans — both submitted and those still in draft form that states do 
not understand the full obligations of ESSA, or if they do, are choosing to blatantly ignore its requirements. 
We have seen very troubling provisions in state plans thus far that: 
® reduce or limit expectations of students (e.g. by setting low achievement goals); 
* avoid full transparency in the data (e.g. by selecting a high N size or not using data disaggregated 
by student subgroup for differentiation and identification of schools in need of improvement); 
e diminish the importance of honest measures of the academic progress of all children (e.g. proposing 
low proficiency or graduation rates); or, 
» ‘delay interventions when any group of students is struggling academically. 


Additionally, ESSA requires that states describe how they will support districts 


...to improve school conditions for student learning, including through 
reducing—(i) incidences of bullying and harassment; (ii) the overuse of discipline 
practices that remove students from the classroom; and (iii) the use of aversive 
behavioral interventions that compromise student health and safety.’ 


And, the ESSA Conference Report clarifies that the term “aversive behavioral interventions” means 
seclusion and restraint.” In 2013-2014, 70,000 students with disabilities were subjected to seclusion and 
restraint and students with disabilities had more than double the suspension rate of students without 
disabilities.” Clearly every state needs to include strategies to work with districts on reducing and 
eliminating the use of aversive behavioral interventions such as seclusion and restraint in its ESSA plan. 
We do not see this adequately addressed in any of the plans reviewed so far. Given the number of students 
subjected to restraint, seclusion, and other means of removal from the learning environment, and the 
growing occurrence bullying, this is one of the most important provisions of the law and it must be upheld. 


ESSA was passed with bipartisan support and is the nation’s plan for how to improve public education so 
all students have an equal opportunity to learn and to succeed. States wanted to be in the driver's seat and 
now must take seriously the responsibility they've been given under ESSA to reimagine, re-design and 
rework accountability systems so that all kids count and are making progress according to state designed 
criteria. When reliable school and student subgroup data show that any students are not: such data need to 
be used to strategically and meaningfully inform teaching, academic and behavior intervention, 
professional learning and the allocation of staff and resources. ESSA’s accountability provisions were 
intentionally designed to provide transparency for parents and the public about how all public education 
students are faring and to help districts identify which schools need intervention and support. The two 
priorities in the law are complementary and one must not overshadow the other; state ESSA plans must 
allow for and include both. Therefore, COPAA urges Congress to remain consistent in its request of ED 
that state ESSA plans follow the law. Our kids deserve and we will settle for nothing less. 


COPAA is a national a nonprofit organization of parents, attorneys, advocates, and related professionals who work to protect the 
civil rights and secure excellence in education on behalf of the 6.4 million children with disabilities attending public school 
across the United States. 


Contact: Denise Marshall, 443-310-8638 denise@copaa.org 
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PO Box 6767, Towson MD 21285 — Ph: (844)426-7224 www.copaa.org 


IPL. 114-95 


#® With Greater Power Under ESSA, State Education Officials Commit to an Era of Greater Responsibility, (2016) the74. Retrieved at: 


-greater-p ower-under-essa-state-education-officials-commit-to-an-era-of-greater-responsibility. 


S., (2016), Testimony before the House Subcommitiee on Early Education, Elementary and Secondary Education, Retrieved 
e house, zov/uploaded files‘testimony almazan.pdf 


Y PLL, 114-95, Every Student Succeeds Act. § 1141(g)1)C)ii). 


¥ Every Student Succeeds Act (2015) Conference Report to Accompany S.1777. 
hitps /Awww,congress.gow/ 1 14/erpt/hrpt354/CRPT-1 14hrpt354 pdf 


il Rights Data Collection, March 2614. 


Schoai Discipline 
‘de-discipline-snapsh 
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DEFEND EDUCATE EMPOWER 


July 17, 2017 


Representative Virginia Foxx 
2262 Rayburn House Office Building 
Washington, DC 20515 


Representative Bobby Scott 
1201 Longworth House Office Building 
Washington, DC 20515 


RE: Hearing Regarding ESSA Implementation: Exploring State and Local 
Reform Efforts 


Dear Chair Foxx and Ranking Member Scott: 


On behalf of the NAACP Legal Defense and Educational Fund, Inc. (“LDF”), wé 
write to express our strong support for the robust implementation of the Every Student 
Succeeds Act (ESSA) of 2015, including the U.S. Department of Education’s (“the 
Department”) thorough review of state plans submitted under the law. 


Founded in 1940 by Thurgood Marshall, LDF is the nation’s oldest civil rights law 
organization. For 76 years, LDF has relied on the Constitution and federal and state civil 
rights laws to pursue equality and justice for African-Americans and other people of color. 
LDF litigated and won the historic U.S. Supreme Court case Brown v. Board of Education, 
which established the principle of equal access to education for all students and outlawed 
racial segregation in our nation's schools.! Since Brown, LDF has continued to represent 
students in school districts, primarily in the South, to ensure they receive quality and 
equitable educational opportunities.? 


1347 U.S. 483 (1954). 
2 See, e.g., Thomas, etal. v. St. Martin Parish School Dist., et al., Civil Action No. 6:65-ev-11314, Doc. 178 (W.D. La., 
Jan. 25, 2016) (approving a school desegregation plan designed to racially integrate St, Martin Parish School District and ensure 
African-American students have equal access to quality educational opportunities), http./Avww.naacpldf org/update/ldt- 
announces-consent-decree-thomas-v-school-board-st-martin-; see also LDF Urges Robust Implementation of Every Student 
4) to Close bua aes Gaps and Promote Student Success, http:/iwww.naacpldf.org/case-issue/td furges- 
i Beene ch Sec tach Br. for the Block nies Alliance at the 


hep: eae i ianspld a org 
981920bsac%20The%20BIa 
2Qat_1_Lpdf. 


SDStudent®20Atliance%2 2at%o2the%20University%220of%20T ey lt 20 Austin%206(% 


NAACP LEGAL DEFENSE AND EDUCATIONAL FUND, INC. 


113 


LDF 


Sd 
DEFEND EDUCATE EMPOWER 


ESSA was intended to address a key issue our country has been grappling with for 
decades—equitable education for every child. The Elementary and Secondary Education 
Act, the original version of the law, is a civil rights law created to ensure that historically 
underserved children and youth receive the resources and supports they require to 
succeed? That important creed remains the goal of ESSA today. Despite gains made to 
close achievement gaps among marginalized student subgroups—students of color, low- 
income students, students with disabilities, and English learners—persistent inequality 
remains, 


The Department of Education is responsible for ensuring that state plans under 
ESSA detail effective policies and practices that enable states and districts “to provide all 
children significant opportunity to receive a fair, equitable, and high-quality education, and 
to close educational achievement gaps.”4 We understand that the Department has provided 
interim feedback to several states that submitted their plans in March or April. The 
Department has a responsibility to thoroughly review and provide feedback on each state 
plan and to refuse to approve any plan that does not comply with this bi-partisan law 
passed by Congress. 


We understand there have been inconsistencies in the Department's feedback and 
that some of this feedback has failed to address all areas where state plans have not met 
the requirements of the law. We urge the Department to carry out its responsibility to 
ensure that the feedback states receive is thorough and consistent to ensure the effective 
implementation of the law. We will continue to monitor the state plan approval process. 


We also urge you to ensure that states and districts have the resources they need to 
meet the goals of ESSA by ensuring that the budget for the Education Department for FY. 
2018 includes adequate funding for programs that support teacher quality, as well as 
programs that provide other critical supports, including those under Title 1 and Title IV. 


Thank you for considering this request. If you have any questions, please contact us at 202- 
682-1300. 
Sincerely, 
Fag eA 
Hebe a lg 
7 


Todd A. Cox 
Director of Policy 


+79 Stat. 27-58. 


4 Every Student Succeeds Act, Public Law No. 114.95, S. 1177, U4th Cong. $1001 (Dec. 10, 2015) (hereinafter, 


ESSA), 
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Monique L. Dixon 
Deputy Director of Policy 


Elizabeth Olsson 
Senior Policy Associate 
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y « SYNDROME 
STATEMENT OF THE 


NATIONAL DOWN SYNDROME CONGRESS ON ESSA STATE PLANS 
House Education and Workforce Hearing July 18, 2017 


The National Down Syndrome Congress and the Advocacy Institute have reviewed more 
than 30 Every Students Succeeds Act (ESSA) state plans (drafts or submitted) and provide 
detailed analyses at http://www.advocacvinstitute.org/ESSA/ESSA- 
StateDraftPlanAnalysis.shtml. 


While we applaud some decisions made by states in these plans, there are none that 
completely lived up to the requirements and the purpose of the law: “to provide all children 
significant opportunity to receive a fair, equitable and high quality education, and to close 
educational achievement gaps.” In fact many of the states did not develop these plans with 
meaningful stakeholder consultation as required by the law and released drafts for public 
comment that were incomplete. Some states have yet to release a draft of their plan to the 
public, even though the deadline for submission is fast approaching. 


NDSC is also troubled by the way many states are addressing two gateway issues regarding 
accountability: minimum subgroup (N) size and the failure of schools to assess 95% of all 
students and each subgroup. Both of these issues, must be handled in way that ensures 
maximum accountability for students with disabilities, as well as other student subgroups, 
in order for the purpose of the law to be fulfilled. 


There are many other issues in the submitted and draft state plans that are of great concern 
to NDSC. The three most critical issues impacting student subgroups, including students 
with disabilities, are: 

e Definitions of consistently underperforming subgroup that would allow students to 
fall too far behind, for too long, before schools are identified for targeted support 
and improvement plans 

« Long-term goals and interim targets goals that are not ambitious enough to close 
achievement gaps 

e A failure to factor subgroup performance into the school rating system that 
determines how schools are treated in the accountability system 


The U.S. Department of Education (ED) has been reviewing state ESSA plans and providing 
feedback on critical issues. This federal oversight is a key responsibility of ED and is 
critically important to ensure that ESSA funds will be used to meet the purpose of the law. 
NDSC urges Congress to support ED in these efforts, 


Contact: Ricki Sabia, NDSC Senior Education Policy Advisor 
ricki@ndsccenter.org 301-452-0811 
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About the National Down Syndrome Congress 

Founded in 1973, the National Down Syndrome Congress is the country’s oldest organization 
for people with Down syndrome, their families, and the professionals who work with them. A 
501(c)(3) non-profit advocacy organization, the NDSC provides support and information 
about issues related to Down syndrome throughout the lifespan, as well as on matters of 
public policy relating to disability rights. The National Down Syndrome Congress is 
committed to creating a national climate in which all people will recognize and embrace the 
value and dignity of people with Down syndrome. For more information about the NDSC, 


please visit our website at www.ndsccenter.org. 


[Whereupon, at 12:32 p.m., the committee was adjourned. ] 
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